8841 lines
1.8 MiB
8841 lines
1.8 MiB
2026-01-15 00:00:00.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768406400 status=200 resp_size=5017
|
||
2026-01-15 00:00:01.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406400&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:00:16.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768406406 status=200 resp_size=6688
|
||
2026-01-15 00:00:16.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406416&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 00:00:23.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768406420 status=200 resp_size=5498
|
||
2026-01-15 00:00:25.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406423&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 00:00:31.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768406430 status=200 resp_size=6519
|
||
2026-01-15 00:00:31.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406431&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:00:35.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768406434 status=200 resp_size=6479
|
||
2026-01-15 00:00:35.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406435&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 00:00:42.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768406441 status=200 resp_size=5925
|
||
2026-01-15 00:00:42.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406442&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 00:00:45.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768406445 status=200 resp_size=7762
|
||
2026-01-15 00:00:45.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406445&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 00:00:49.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768406449 status=200 resp_size=5700
|
||
2026-01-15 00:00:50.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406449&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:00:52.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768406451 status=200 resp_size=7971
|
||
2026-01-15 00:00:52.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406452&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 00:00:55.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768406455 status=200 resp_size=8331
|
||
2026-01-15 00:00:55.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406455&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 00:01:00.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768406460 status=200 resp_size=5424
|
||
2026-01-15 00:01:00.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406460&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 00:01:04.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768406464 status=200 resp_size=8465
|
||
2026-01-15 00:01:04.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406464&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:01:14.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768406472 status=200 resp_size=8995
|
||
2026-01-15 00:01:14.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406474&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 00:01:22.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768406482 status=200 resp_size=6706
|
||
2026-01-15 00:01:23.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406482&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 00:01:23.084 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:01:29.251 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:01:29.251 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 00:01:37.440 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.17 秒后继续...
|
||
2026-01-15 00:01:37.440 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 00:01:37.441 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:01:37.471 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:01:43.948 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:01:45.127 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:01:47.372 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:01:47.372 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:02:03.978 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768406497 status=200 resp_size=135913
|
||
2026-01-15 00:02:03.978 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位(已跳过)
|
||
2026-01-15 00:02:03.978 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 18) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:02:06.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768406523 status=200 resp_size=6080
|
||
2026-01-15 00:02:06.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406526&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 00:02:32.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768406533 status=200 resp_size=4916
|
||
2026-01-15 00:02:45.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406552&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 00:02:52.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768406571 status=200 resp_size=5442
|
||
2026-01-15 00:02:52.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406572&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:02:57.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768406577 status=200 resp_size=6083
|
||
2026-01-15 00:02:57.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406577&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 00:03:05.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768406583 status=200 resp_size=6512
|
||
2026-01-15 00:03:06.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406585&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 00:03:07.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768406587 status=200 resp_size=6243
|
||
2026-01-15 00:03:08.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406587&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 00:03:10.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768406589 status=200 resp_size=6174
|
||
2026-01-15 00:03:12.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406590&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:03:21.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768406600 status=200 resp_size=5691
|
||
2026-01-15 00:03:21.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406601&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5013
|
||
2026-01-15 00:03:25.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768406605 status=200 resp_size=5602
|
||
2026-01-15 00:03:26.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406605&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 00:03:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768406613 status=200 resp_size=5761
|
||
2026-01-15 00:03:34.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406614&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 00:03:41.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768406620 status=200 resp_size=5810
|
||
2026-01-15 00:03:41.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406621&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:03:50.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768406630 status=200 resp_size=6552
|
||
2026-01-15 00:03:51.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406630&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:03:58.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768406638 status=200 resp_size=8622
|
||
2026-01-15 00:03:58.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406638&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 00:04:03.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768406643 status=200 resp_size=8723
|
||
2026-01-15 00:04:03.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406643&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 00:04:11.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768406651 status=200 resp_size=6017
|
||
2026-01-15 00:04:11.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406651&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 00:04:13.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768406653 status=200 resp_size=7941
|
||
2026-01-15 00:04:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406653&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 00:04:23.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768406662 status=200 resp_size=7589
|
||
2026-01-15 00:04:23.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406663&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 00:04:28.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768406668 status=200 resp_size=5284
|
||
2026-01-15 00:04:29.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406668&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 00:04:29.066 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 18
|
||
2026-01-15 00:04:34.731 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
|
||
2026-01-15 00:04:34.731 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 00:04:36.557 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.82 秒后继续...
|
||
2026-01-15 00:04:36.557 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 00:04:36.557 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:04:36.586 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:04:37.234 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:04:38.390 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:04:40.570 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:04:40.570 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:04:41.042 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768406676 status=200 resp_size=134458
|
||
2026-01-15 00:04:41.042 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:04:41.042 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:04:41.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768406681 status=200 resp_size=6680
|
||
2026-01-15 00:04:41.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406681&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 00:04:49.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768406689 status=200 resp_size=5408
|
||
2026-01-15 00:04:49.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406689&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 00:04:58.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768406696 status=200 resp_size=6647
|
||
2026-01-15 00:04:58.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406698&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 00:05:01.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768406701 status=200 resp_size=5289
|
||
2026-01-15 00:05:02.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406701&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 00:05:10.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768406709 status=200 resp_size=6302
|
||
2026-01-15 00:05:10.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406710&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:05:19.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768406718 status=200 resp_size=5924
|
||
2026-01-15 00:05:19.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406719&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 00:05:29.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768406728 status=200 resp_size=6021
|
||
2026-01-15 00:05:29.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406729&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 00:05:35.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768406734 status=200 resp_size=5728
|
||
2026-01-15 00:05:35.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406735&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 00:05:44.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768406743 status=200 resp_size=5396
|
||
2026-01-15 00:05:44.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406744&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 00:05:48.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768406748 status=200 resp_size=5082
|
||
2026-01-15 00:05:48.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406748&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:05:57.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768406756 status=200 resp_size=13285
|
||
2026-01-15 00:05:57.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406757&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 00:06:04.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768406763 status=200 resp_size=6876
|
||
2026-01-15 00:06:04.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406764&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 00:06:10.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768406769 status=200 resp_size=6059
|
||
2026-01-15 00:06:10.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406770&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 00:06:14.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768406774 status=200 resp_size=5280
|
||
2026-01-15 00:06:14.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406774&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 00:06:22.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768406782 status=200 resp_size=9513
|
||
2026-01-15 00:06:23.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406782&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 00:06:28.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768406787 status=200 resp_size=6588
|
||
2026-01-15 00:06:28.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406788&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 00:06:35.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768406793 status=200 resp_size=8070
|
||
2026-01-15 00:06:35.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406795&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 00:06:40.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768406799 status=200 resp_size=6342
|
||
2026-01-15 00:06:41.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406800&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 00:06:45.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768406805 status=200 resp_size=6091
|
||
2026-01-15 00:06:45.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406805&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:06:45.802 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:06:51.626 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:06:51.626 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 00:06:58.506 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.87 秒后继续...
|
||
2026-01-15 00:06:58.506 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 00:06:58.506 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:06:58.531 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:06:59.300 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:07:00.461 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:07:02.643 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:07:02.643 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:07:03.303 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768406818 status=200 resp_size=129273
|
||
2026-01-15 00:07:03.303 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:07:03.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768406823 status=200 resp_size=5357
|
||
2026-01-15 00:07:03.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406823&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 00:07:15.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768406831 status=200 resp_size=4656
|
||
2026-01-15 00:07:15.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406835&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 00:07:23.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768406842 status=200 resp_size=5014
|
||
2026-01-15 00:07:23.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406843&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 00:07:30.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768406849 status=200 resp_size=7224
|
||
2026-01-15 00:07:30.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406850&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 00:07:36.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768406855 status=200 resp_size=5584
|
||
2026-01-15 00:07:36.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406856&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:07:40.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768406860 status=200 resp_size=5070
|
||
2026-01-15 00:07:40.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406860&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 00:07:42.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768406861 status=200 resp_size=4986
|
||
2026-01-15 00:07:42.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406862&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:07:47.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768406866 status=200 resp_size=6774
|
||
2026-01-15 00:07:47.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406867&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:07:55.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768406874 status=200 resp_size=5883
|
||
2026-01-15 00:07:55.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406875&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 00:08:04.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768406884 status=200 resp_size=5165
|
||
2026-01-15 00:08:05.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406884&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 00:08:07.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768406887 status=200 resp_size=5732
|
||
2026-01-15 00:08:07.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406887&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 00:08:18.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768406897 status=200 resp_size=7569
|
||
2026-01-15 00:08:18.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406898&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 00:08:25.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768406904 status=200 resp_size=8202
|
||
2026-01-15 00:08:25.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406905&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 00:08:31.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768406910 status=200 resp_size=6980
|
||
2026-01-15 00:08:31.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406911&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 00:08:41.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768406920 status=200 resp_size=5313
|
||
2026-01-15 00:08:41.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:08:45.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768406925 status=200 resp_size=5498
|
||
2026-01-15 00:08:46.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406925&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 00:08:55.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768406934 status=200 resp_size=4643
|
||
2026-01-15 00:08:55.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406935&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 00:09:05.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768406944 status=200 resp_size=5590
|
||
2026-01-15 00:09:05.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406945&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 00:09:07.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768406947 status=200 resp_size=5700
|
||
2026-01-15 00:09:07.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406947&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 00:09:14.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768406953 status=200 resp_size=6288
|
||
2026-01-15 00:09:14.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406954&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 00:09:14.600 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:09:14.945 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:09:14.945 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 00:09:21.825 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.87 秒后继续...
|
||
2026-01-15 00:09:21.825 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 00:09:21.825 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:09:21.847 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:09:22.400 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:09:23.534 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:09:25.656 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:09:25.656 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:09:26.111 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768406961 status=200 resp_size=163072
|
||
2026-01-15 00:09:26.111 | WARNING | __main__:get_recommend_jobs:745 - 第 13 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:09:26.111 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:09:26.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768406966 status=200 resp_size=6627
|
||
2026-01-15 00:09:26.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406966&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 00:09:36.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768406976 status=200 resp_size=7987
|
||
2026-01-15 00:09:37.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406976&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 00:09:46.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768406985 status=200 resp_size=6002
|
||
2026-01-15 00:09:46.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406986&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 00:09:51.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768406990 status=200 resp_size=7243
|
||
2026-01-15 00:09:51.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768406991&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 00:10:01.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768407000 status=200 resp_size=5600
|
||
2026-01-15 00:10:01.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407001&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 00:10:06.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768407006 status=200 resp_size=6935
|
||
2026-01-15 00:10:06.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407006&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 00:10:09.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768407009 status=200 resp_size=5942
|
||
2026-01-15 00:10:09.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407009&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 00:10:17.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768407016 status=200 resp_size=6602
|
||
2026-01-15 00:10:17.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407017&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 00:10:21.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768407021 status=200 resp_size=6027
|
||
2026-01-15 00:10:21.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407021&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 00:10:23.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768407023 status=200 resp_size=6079
|
||
2026-01-15 00:10:23.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407023&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:10:26.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768407026 status=200 resp_size=6264
|
||
2026-01-15 00:10:27.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407026&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 00:10:30.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768407029 status=200 resp_size=5277
|
||
2026-01-15 00:10:30.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407030&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 00:10:39.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768407038 status=200 resp_size=6138
|
||
2026-01-15 00:10:39.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407039&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 00:10:48.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768407047 status=200 resp_size=6522
|
||
2026-01-15 00:10:48.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407048&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 00:10:51.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768407050 status=200 resp_size=7299
|
||
2026-01-15 00:10:51.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407051&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 00:10:55.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768407055 status=200 resp_size=8800
|
||
2026-01-15 00:10:55.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407055&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 00:11:06.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768407065 status=200 resp_size=6727
|
||
2026-01-15 00:11:06.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407066&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 00:11:10.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768407070 status=200 resp_size=8688
|
||
2026-01-15 00:11:10.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407070&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 00:11:17.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768407077 status=200 resp_size=6462
|
||
2026-01-15 00:11:18.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407077&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 00:11:18.136 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:11:24.128 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:11:24.128 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 00:11:28.451 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.32 秒后继续...
|
||
2026-01-15 00:11:28.451 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 00:11:28.451 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:11:28.464 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:11:29.083 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:11:30.253 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:11:32.394 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:11:32.394 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:11:32.835 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407088 status=200 resp_size=132780
|
||
2026-01-15 00:11:32.835 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:11:33.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768407092 status=200 resp_size=7907
|
||
2026-01-15 00:11:33.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407093&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 00:11:39.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768407098 status=200 resp_size=5872
|
||
2026-01-15 00:11:39.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407099&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 00:11:43.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768407103 status=200 resp_size=5922
|
||
2026-01-15 00:11:43.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407103&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 00:11:54.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768407113 status=200 resp_size=6455
|
||
2026-01-15 00:11:55.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407114&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 00:11:57.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768407117 status=200 resp_size=6659
|
||
2026-01-15 00:11:58.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407117&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:12:00.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768407119 status=200 resp_size=5182
|
||
2026-01-15 00:12:00.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407120&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 00:12:04.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768407124 status=200 resp_size=7340
|
||
2026-01-15 00:12:05.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407124&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 00:12:12.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768407131 status=200 resp_size=7014
|
||
2026-01-15 00:12:12.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407132&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 00:12:21.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768407141 status=200 resp_size=6569
|
||
2026-01-15 00:12:22.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407141&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 00:12:24.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768407143 status=200 resp_size=5499
|
||
2026-01-15 00:12:24.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407144&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 00:12:34.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768407154 status=200 resp_size=6166
|
||
2026-01-15 00:12:35.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407154&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 00:12:45.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768407164 status=200 resp_size=5673
|
||
2026-01-15 00:12:45.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407165&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 00:12:49.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768407168 status=200 resp_size=7116
|
||
2026-01-15 00:12:49.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407169&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 00:12:50.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768407170 status=200 resp_size=7664
|
||
2026-01-15 00:12:50.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407170&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 00:13:00.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768407177 status=200 resp_size=6652
|
||
2026-01-15 00:13:01.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407180&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 00:13:11.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768407191 status=200 resp_size=4737
|
||
2026-01-15 00:13:11.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407191&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:13:17.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768407196 status=200 resp_size=4926
|
||
2026-01-15 00:13:17.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407197&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 00:13:21.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768407201 status=200 resp_size=4902
|
||
2026-01-15 00:13:21.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407201&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 00:13:24.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768407203 status=200 resp_size=7399
|
||
2026-01-15 00:13:24.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407204&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 00:13:29.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768407209 status=200 resp_size=4825
|
||
2026-01-15 00:13:29.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407209&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:13:29.604 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:13:35.434 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:13:35.434 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 00:13:44.982 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.54 秒后继续...
|
||
2026-01-15 00:13:44.982 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 00:13:44.983 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:13:44.988 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:13:45.726 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:13:46.888 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:13:49.305 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:13:49.305 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:13:50.389 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407224 status=200 resp_size=134824
|
||
2026-01-15 00:13:50.389 | WARNING | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:13:50.389 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 516 (原始值: 516) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:13:51.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768407230 status=200 resp_size=5006
|
||
2026-01-15 00:13:52.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407231&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 00:13:58.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768407237 status=200 resp_size=5363
|
||
2026-01-15 00:13:58.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407238&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 00:13:59.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768407239 status=200 resp_size=5259
|
||
2026-01-15 00:13:59.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407239&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 00:14:04.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768407244 status=200 resp_size=5312
|
||
2026-01-15 00:14:04.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407244&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 00:14:08.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768407248 status=200 resp_size=5262
|
||
2026-01-15 00:14:08.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407248&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 00:14:10.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768407249 status=200 resp_size=6972
|
||
2026-01-15 00:14:10.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407250&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 00:14:13.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768407253 status=200 resp_size=4974
|
||
2026-01-15 00:14:13.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407253&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:14:15.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768407255 status=200 resp_size=7412
|
||
2026-01-15 00:14:16.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407255&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 00:14:18.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768407258 status=200 resp_size=7364
|
||
2026-01-15 00:14:18.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407258&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 00:14:27.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768407266 status=200 resp_size=5105
|
||
2026-01-15 00:14:27.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407267&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 00:14:36.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768407275 status=200 resp_size=4537
|
||
2026-01-15 00:14:36.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407276&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 00:14:38.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768407278 status=200 resp_size=4865
|
||
2026-01-15 00:14:38.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407278&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 00:14:40.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768407280 status=200 resp_size=5409
|
||
2026-01-15 00:14:40.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407280&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 00:14:51.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768407290 status=200 resp_size=6333
|
||
2026-01-15 00:14:51.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407291&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 00:15:02.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768407301 status=200 resp_size=5668
|
||
2026-01-15 00:15:02.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407302&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 00:15:11.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768407311 status=200 resp_size=6169
|
||
2026-01-15 00:15:12.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407311&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 00:15:13.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768407313 status=200 resp_size=5470
|
||
2026-01-15 00:15:13.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407313&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 00:15:21.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768407321 status=200 resp_size=5725
|
||
2026-01-15 00:15:22.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407321&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 00:15:32.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768407331 status=200 resp_size=4737
|
||
2026-01-15 00:15:32.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407332&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 00:15:32.609 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:15:38.258 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:15:38.258 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 00:15:44.088 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.82 秒后继续...
|
||
2026-01-15 00:15:44.088 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 00:15:44.088 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:15:44.111 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:15:44.755 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:15:45.901 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:15:48.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:15:48.038 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:15:48.512 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407344 status=200 resp_size=129714
|
||
2026-01-15 00:15:48.512 | WARNING | __main__:get_recommend_jobs:745 - 第 16 页发现 2 个重复职位(已跳过)
|
||
2026-01-15 00:15:48.512 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 18) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:15:48.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768407348 status=200 resp_size=4332
|
||
2026-01-15 00:15:48.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407348&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 00:15:58.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768407357 status=200 resp_size=5139
|
||
2026-01-15 00:15:58.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407358&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:16:00.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768407360 status=200 resp_size=5740
|
||
2026-01-15 00:16:00.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407360&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 00:16:03.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768407362 status=200 resp_size=6326
|
||
2026-01-15 00:16:03.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407363&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 00:16:05.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768407365 status=200 resp_size=7248
|
||
2026-01-15 00:16:05.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407365&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 00:16:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768407371 status=200 resp_size=5483
|
||
2026-01-15 00:16:12.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407372&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 00:16:14.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768407374 status=200 resp_size=5063
|
||
2026-01-15 00:16:14.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407374&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 00:16:17.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768407377 status=200 resp_size=5631
|
||
2026-01-15 00:16:17.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407377&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 00:16:20.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768407380 status=200 resp_size=5991
|
||
2026-01-15 00:16:20.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407380&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 00:16:30.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768407389 status=200 resp_size=5928
|
||
2026-01-15 00:16:30.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407390&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 00:16:39.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768407398 status=200 resp_size=6317
|
||
2026-01-15 00:16:39.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407399&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 00:16:46.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768407405 status=200 resp_size=5524
|
||
2026-01-15 00:16:46.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407406&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 00:16:48.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768407408 status=200 resp_size=5204
|
||
2026-01-15 00:16:48.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407408&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 00:16:50.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768407410 status=200 resp_size=4654
|
||
2026-01-15 00:16:50.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407410&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 00:16:54.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768407414 status=200 resp_size=7075
|
||
2026-01-15 00:16:54.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407414&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 00:17:00.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768407420 status=200 resp_size=6576
|
||
2026-01-15 00:17:00.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407420&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 00:17:07.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768407426 status=200 resp_size=4772
|
||
2026-01-15 00:17:07.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407427&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 00:17:13.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768407433 status=200 resp_size=5389
|
||
2026-01-15 00:17:14.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407433&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:17:14.151 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 18
|
||
2026-01-15 00:17:14.512 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
|
||
2026-01-15 00:17:14.512 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 00:17:21.637 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.12 秒后继续...
|
||
2026-01-15 00:17:21.637 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 00:17:21.637 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:17:21.652 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:17:22.248 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:17:23.379 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:17:25.527 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:17:25.527 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:17:26.000 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407441 status=200 resp_size=130025
|
||
2026-01-15 00:17:26.000 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:17:26.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768407446 status=200 resp_size=6325
|
||
2026-01-15 00:17:26.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407446&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 00:17:32.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768407451 status=200 resp_size=6103
|
||
2026-01-15 00:17:32.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407452&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 00:17:40.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768407459 status=200 resp_size=5106
|
||
2026-01-15 00:17:40.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407460&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 00:17:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768407466 status=200 resp_size=5328
|
||
2026-01-15 00:17:47.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407467&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 00:17:57.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768407477 status=200 resp_size=5141
|
||
2026-01-15 00:17:57.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407477&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 00:18:05.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768407484 status=200 resp_size=5935
|
||
2026-01-15 00:18:05.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407485&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 00:18:13.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768407492 status=200 resp_size=6001
|
||
2026-01-15 00:18:13.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407493&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 00:18:14.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768407494 status=200 resp_size=5304
|
||
2026-01-15 00:18:14.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407494&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 00:18:23.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768407502 status=200 resp_size=4719
|
||
2026-01-15 00:18:23.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407503&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 00:18:29.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768407509 status=200 resp_size=7754
|
||
2026-01-15 00:18:29.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407509&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 00:18:32.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768407512 status=200 resp_size=6686
|
||
2026-01-15 00:18:32.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407512&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 00:18:34.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768407514 status=200 resp_size=5693
|
||
2026-01-15 00:18:35.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407514&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:18:43.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768407523 status=200 resp_size=5316
|
||
2026-01-15 00:18:44.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407523&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:18:50.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768407530 status=200 resp_size=5989
|
||
2026-01-15 00:18:51.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407530&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 00:18:54.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768407534 status=200 resp_size=5335
|
||
2026-01-15 00:18:54.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407534&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:18:59.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768407539 status=200 resp_size=5236
|
||
2026-01-15 00:18:59.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407539&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:19:03.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768407543 status=200 resp_size=4798
|
||
2026-01-15 00:19:03.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407543&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 00:19:12.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768407550 status=200 resp_size=5591
|
||
2026-01-15 00:19:12.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407552&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:19:21.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768407561 status=200 resp_size=5870
|
||
2026-01-15 00:19:21.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407561&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 00:19:23.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768407563 status=200 resp_size=5360
|
||
2026-01-15 00:19:23.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407563&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 00:19:23.552 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:19:23.912 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:19:23.912 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 00:19:27.360 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.45 秒后继续...
|
||
2026-01-15 00:19:27.360 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 00:19:27.360 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:19:27.381 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:19:28.008 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:19:29.140 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:19:31.288 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:19:31.288 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:19:31.774 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407567 status=200 resp_size=130142
|
||
2026-01-15 00:19:31.774 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:19:31.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768407571 status=200 resp_size=5677
|
||
2026-01-15 00:19:32.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407571&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 00:19:38.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768407577 status=200 resp_size=5317
|
||
2026-01-15 00:19:38.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407578&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:19:41.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768407580 status=200 resp_size=5668
|
||
2026-01-15 00:19:41.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407581&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 00:19:43.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768407582 status=200 resp_size=4333
|
||
2026-01-15 00:19:43.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407583&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 00:19:45.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768407585 status=200 resp_size=6284
|
||
2026-01-15 00:19:45.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407585&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 00:19:48.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768407588 status=200 resp_size=5510
|
||
2026-01-15 00:19:48.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407588&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:19:52.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768407592 status=200 resp_size=5151
|
||
2026-01-15 00:19:52.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407592&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:19:55.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768407595 status=200 resp_size=5511
|
||
2026-01-15 00:19:56.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407595&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 00:20:00.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768407599 status=200 resp_size=6484
|
||
2026-01-15 00:20:00.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407600&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:20:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768407609 status=200 resp_size=8675
|
||
2026-01-15 00:20:10.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407610&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 00:20:18.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768407617 status=200 resp_size=5968
|
||
2026-01-15 00:20:18.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407618&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 00:20:27.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768407627 status=200 resp_size=8440
|
||
2026-01-15 00:20:27.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407627&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 00:20:37.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768407637 status=200 resp_size=6514
|
||
2026-01-15 00:20:37.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407637&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:20:46.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768407645 status=200 resp_size=5227
|
||
2026-01-15 00:20:46.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407646&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 00:20:54.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768407653 status=200 resp_size=6408
|
||
2026-01-15 00:20:54.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407654&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 00:21:05.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768407661 status=200 resp_size=6062
|
||
2026-01-15 00:21:07.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407665&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 00:21:16.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768407674 status=200 resp_size=5708
|
||
2026-01-15 00:21:16.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407676&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 00:21:24.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768407682 status=200 resp_size=5449
|
||
2026-01-15 00:21:24.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407684&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 00:21:31.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768407690 status=200 resp_size=6979
|
||
2026-01-15 00:21:31.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407691&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 00:21:34.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768407693 status=200 resp_size=5846
|
||
2026-01-15 00:21:34.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407694&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 00:21:34.285 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:21:34.630 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:21:34.630 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 00:21:39.476 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.84 秒后继续...
|
||
2026-01-15 00:21:39.476 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 00:21:39.476 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:21:39.497 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:21:40.094 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:21:41.240 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:21:43.375 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:21:43.375 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:21:43.751 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407699 status=200 resp_size=107988
|
||
2026-01-15 00:21:43.751 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:21:43.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768407703 status=200 resp_size=5494
|
||
2026-01-15 00:21:44.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407703&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 00:21:54.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768407713 status=200 resp_size=5845
|
||
2026-01-15 00:21:54.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407714&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 00:21:56.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768407716 status=200 resp_size=6139
|
||
2026-01-15 00:21:56.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407716&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 00:21:58.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768407718 status=200 resp_size=5603
|
||
2026-01-15 00:21:58.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407718&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 00:22:05.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768407725 status=200 resp_size=5632
|
||
2026-01-15 00:22:06.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407725&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 00:22:12.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768407731 status=200 resp_size=6222
|
||
2026-01-15 00:22:12.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 00:22:18.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768407738 status=200 resp_size=7752
|
||
2026-01-15 00:22:19.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407738&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 00:22:23.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768407742 status=200 resp_size=5400
|
||
2026-01-15 00:22:23.655 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407743&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 00:22:31.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768407749 status=200 resp_size=5846
|
||
2026-01-15 00:22:31.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407751&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 00:22:34.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768407754 status=200 resp_size=4627
|
||
2026-01-15 00:22:34.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407754&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 00:22:50.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768407763 status=200 resp_size=6085
|
||
2026-01-15 00:22:50.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407770&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:22:51.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768407771 status=200 resp_size=6328
|
||
2026-01-15 00:22:52.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407771&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 00:23:01.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768407780 status=200 resp_size=6899
|
||
2026-01-15 00:23:01.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407781&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 00:23:05.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768407785 status=200 resp_size=5290
|
||
2026-01-15 00:23:05.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407785&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 00:23:09.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768407789 status=200 resp_size=5974
|
||
2026-01-15 00:23:09.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407789&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:23:14.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768407794 status=200 resp_size=6423
|
||
2026-01-15 00:23:15.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407794&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 00:23:19.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768407799 status=200 resp_size=6508
|
||
2026-01-15 00:23:19.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407799&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 00:23:29.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768407809 status=200 resp_size=6214
|
||
2026-01-15 00:23:29.823 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407809&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 00:23:37.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768407817 status=200 resp_size=6073
|
||
2026-01-15 00:23:37.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407817&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:23:41.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768407821 status=200 resp_size=5526
|
||
2026-01-15 00:23:41.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407821&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 00:23:41.484 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:23:41.751 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:23:41.751 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 00:23:50.770 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.01 秒后继续...
|
||
2026-01-15 00:23:50.770 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 00:23:50.770 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:23:50.790 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:23:51.356 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:23:52.520 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:23:54.651 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:23:54.651 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:23:55.075 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407830 status=200 resp_size=106143
|
||
2026-01-15 00:23:55.075 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:23:55.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768407835 status=200 resp_size=6821
|
||
2026-01-15 00:23:55.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407835&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 00:24:02.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768407841 status=200 resp_size=5827
|
||
2026-01-15 00:24:02.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407842&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 00:24:08.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768407847 status=200 resp_size=4780
|
||
2026-01-15 00:24:08.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407848&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:24:10.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768407850 status=200 resp_size=7006
|
||
2026-01-15 00:24:11.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407850&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 00:24:13.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768407853 status=200 resp_size=5431
|
||
2026-01-15 00:24:13.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407853&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 00:24:21.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768407861 status=200 resp_size=6066
|
||
2026-01-15 00:24:22.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407861&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 00:24:26.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768407866 status=200 resp_size=5541
|
||
2026-01-15 00:24:26.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407866&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 00:24:29.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768407869 status=200 resp_size=6075
|
||
2026-01-15 00:24:29.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407869&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 00:24:31.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768407871 status=200 resp_size=5879
|
||
2026-01-15 00:24:31.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407871&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 00:24:33.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job×tamp=1768407873 status=200 resp_size=4867
|
||
2026-01-15 00:24:33.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407873&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:24:42.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768407881 status=200 resp_size=5379
|
||
2026-01-15 00:24:42.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407882&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 00:24:46.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768407886 status=200 resp_size=5635
|
||
2026-01-15 00:24:46.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407886&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 00:24:49.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768407889 status=200 resp_size=5496
|
||
2026-01-15 00:24:50.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407889&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 00:24:53.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768407892 status=200 resp_size=6286
|
||
2026-01-15 00:24:53.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407893&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 00:25:01.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768407900 status=200 resp_size=6128
|
||
2026-01-15 00:25:01.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407901&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 00:25:07.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768407906 status=200 resp_size=6326
|
||
2026-01-15 00:25:07.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407907&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 00:25:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768407910 status=200 resp_size=5398
|
||
2026-01-15 00:25:10.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407910&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 00:25:14.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768407914 status=200 resp_size=5324
|
||
2026-01-15 00:25:15.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407914&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:25:19.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768407919 status=200 resp_size=5978
|
||
2026-01-15 00:25:19.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407919&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 00:25:22.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768407922 status=200 resp_size=5662
|
||
2026-01-15 00:25:22.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407922&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 00:25:22.613 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:25:27.959 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:25:27.960 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 00:25:35.409 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.45 秒后继续...
|
||
2026-01-15 00:25:35.409 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 00:25:35.409 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:25:35.436 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:25:36.007 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:25:37.149 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:25:39.296 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:25:39.296 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:25:39.767 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768407935 status=200 resp_size=126687
|
||
2026-01-15 00:25:39.767 | WARNING | __main__:get_recommend_jobs:745 - 第 21 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:25:39.767 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:25:39.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768407939 status=200 resp_size=5833
|
||
2026-01-15 00:25:40.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407939&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 00:25:47.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768407947 status=200 resp_size=6131
|
||
2026-01-15 00:25:47.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407947&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 00:25:50.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768407950 status=200 resp_size=6106
|
||
2026-01-15 00:25:50.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407950&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:25:53.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768407953 status=200 resp_size=5981
|
||
2026-01-15 00:25:54.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407953&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 00:26:03.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768407962 status=200 resp_size=6219
|
||
2026-01-15 00:26:03.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407963&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 00:26:05.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768407965 status=200 resp_size=6036
|
||
2026-01-15 00:26:06.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407965&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 00:26:07.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768407967 status=200 resp_size=5675
|
||
2026-01-15 00:26:07.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407967&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:26:11.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768407971 status=200 resp_size=5849
|
||
2026-01-15 00:26:12.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407971&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 00:26:16.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768407975 status=200 resp_size=6356
|
||
2026-01-15 00:26:16.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407976&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:26:26.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768407985 status=200 resp_size=6351
|
||
2026-01-15 00:26:26.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407986&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 00:26:31.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768407990 status=200 resp_size=5829
|
||
2026-01-15 00:26:31.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768407991&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 00:26:41.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768408000 status=200 resp_size=6497
|
||
2026-01-15 00:26:41.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408001&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:26:49.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768408008 status=200 resp_size=6113
|
||
2026-01-15 00:26:49.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408009&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:26:59.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768408018 status=200 resp_size=5095
|
||
2026-01-15 00:26:59.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408019&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 00:27:09.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768408027 status=200 resp_size=5107
|
||
2026-01-15 00:27:09.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408029&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 00:27:15.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768408034 status=200 resp_size=5473
|
||
2026-01-15 00:27:15.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408035&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:27:20.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768408040 status=200 resp_size=6385
|
||
2026-01-15 00:27:20.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408040&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:27:21.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768408041 status=200 resp_size=4774
|
||
2026-01-15 00:27:22.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408041&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 00:27:25.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768408045 status=200 resp_size=5463
|
||
2026-01-15 00:27:25.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408045&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 00:27:25.933 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:27:31.754 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:27:31.754 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 00:27:41.198 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.43 秒后继续...
|
||
2026-01-15 00:27:41.198 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 00:27:41.198 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:27:41.220 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:27:41.722 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:27:42.837 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:27:44.936 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:27:44.936 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:27:45.423 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408061 status=200 resp_size=135902
|
||
2026-01-15 00:27:45.423 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:27:45.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768408065 status=200 resp_size=6074
|
||
2026-01-15 00:27:45.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408065&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:27:46.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768408066 status=200 resp_size=6963
|
||
2026-01-15 00:27:47.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408066&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:27:50.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768408070 status=200 resp_size=5448
|
||
2026-01-15 00:27:50.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408070&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:27:52.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768408072 status=200 resp_size=6053
|
||
2026-01-15 00:27:52.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408072&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 00:27:57.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768408076 status=200 resp_size=5503
|
||
2026-01-15 00:27:57.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408077&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:28:00.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768408080 status=200 resp_size=7079
|
||
2026-01-15 00:28:00.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408080&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 00:28:06.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768408086 status=200 resp_size=5197
|
||
2026-01-15 00:28:07.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408086&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:28:14.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768408093 status=200 resp_size=7337
|
||
2026-01-15 00:28:14.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408094&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 00:28:18.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768408097 status=200 resp_size=5321
|
||
2026-01-15 00:28:18.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408098&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:28:30.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768408106 status=200 resp_size=6216
|
||
2026-01-15 00:28:31.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408110&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 00:28:42.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768408121 status=200 resp_size=5703
|
||
2026-01-15 00:28:42.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408122&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:28:44.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768408124 status=200 resp_size=5924
|
||
2026-01-15 00:28:44.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408124&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 00:28:48.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768408128 status=200 resp_size=5188
|
||
2026-01-15 00:28:48.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408128&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:28:49.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768408129 status=200 resp_size=6266
|
||
2026-01-15 00:28:50.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408129&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 00:28:52.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768408131 status=200 resp_size=4841
|
||
2026-01-15 00:28:52.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408132&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:28:57.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768408137 status=200 resp_size=6310
|
||
2026-01-15 00:28:57.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408137&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 00:29:02.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768408142 status=200 resp_size=5373
|
||
2026-01-15 00:29:02.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408142&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:29:04.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768408144 status=200 resp_size=5112
|
||
2026-01-15 00:29:05.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408144&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:29:13.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768408151 status=200 resp_size=6150
|
||
2026-01-15 00:29:13.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408153&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 00:29:23.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768408162 status=200 resp_size=4861
|
||
2026-01-15 00:29:24.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408163&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:29:24.028 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:29:24.358 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:29:24.358 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 00:29:31.974 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.61 秒后继续...
|
||
2026-01-15 00:29:31.974 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 00:29:31.974 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:29:32.002 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:29:32.630 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:29:33.814 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:29:36.037 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:29:36.037 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:29:36.523 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408172 status=200 resp_size=133377
|
||
2026-01-15 00:29:36.523 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:29:36.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768408176 status=200 resp_size=5166
|
||
2026-01-15 00:29:36.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408176&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:29:39.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768408179 status=200 resp_size=4962
|
||
2026-01-15 00:29:39.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408179&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:29:42.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768408181 status=200 resp_size=5148
|
||
2026-01-15 00:29:42.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408182&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:29:50.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768408189 status=200 resp_size=5409
|
||
2026-01-15 00:29:50.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408190&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:29:59.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768408198 status=200 resp_size=5055
|
||
2026-01-15 00:29:59.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408199&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:30:03.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768408203 status=200 resp_size=5570
|
||
2026-01-15 00:30:03.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408203&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:30:13.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768408213 status=200 resp_size=4847
|
||
2026-01-15 00:30:14.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408213&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:30:21.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768408220 status=200 resp_size=5461
|
||
2026-01-15 00:30:21.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408221&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:30:25.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768408225 status=200 resp_size=5600
|
||
2026-01-15 00:30:26.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408225&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:30:32.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768408231 status=200 resp_size=5200
|
||
2026-01-15 00:30:32.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408232&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:30:42.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768408242 status=200 resp_size=5032
|
||
2026-01-15 00:30:42.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408242&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:30:46.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768408246 status=200 resp_size=5207
|
||
2026-01-15 00:30:46.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408246&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:30:48.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768408248 status=200 resp_size=5182
|
||
2026-01-15 00:30:49.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408248&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:30:55.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768408254 status=200 resp_size=5173
|
||
2026-01-15 00:30:55.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408255&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:31:05.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768408264 status=200 resp_size=5552
|
||
2026-01-15 00:31:05.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408265&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:31:12.630 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768408272 status=200 resp_size=5489
|
||
2026-01-15 00:31:12.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408272&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:31:20.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768408279 status=200 resp_size=4383
|
||
2026-01-15 00:31:20.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408280&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 00:31:26.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job×tamp=1768408286 status=200 resp_size=6576
|
||
2026-01-15 00:31:27.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408286&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 00:31:35.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768408294 status=200 resp_size=10634
|
||
2026-01-15 00:31:35.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408295&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 00:31:45.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768408304 status=200 resp_size=5295
|
||
2026-01-15 00:31:45.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408305&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:31:45.215 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:31:45.576 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:31:45.576 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 00:31:50.830 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.25 秒后继续...
|
||
2026-01-15 00:31:50.830 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 00:31:50.830 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:31:50.848 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:31:51.445 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:31:52.605 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:31:54.756 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:31:54.756 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:31:55.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408310 status=200 resp_size=124665
|
||
2026-01-15 00:31:55.227 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:31:55.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768408315 status=200 resp_size=5236
|
||
2026-01-15 00:31:55.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408315&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 00:32:03.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768408322 status=200 resp_size=4315
|
||
2026-01-15 00:32:03.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408323&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 00:32:12.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768408332 status=200 resp_size=7628
|
||
2026-01-15 00:32:13.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408332&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 00:32:19.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768408339 status=200 resp_size=4985
|
||
2026-01-15 00:32:20.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408339&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:32:29.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768408348 status=200 resp_size=6205
|
||
2026-01-15 00:32:29.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408349&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 00:32:38.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job×tamp=1768408357 status=200 resp_size=4425
|
||
2026-01-15 00:32:38.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408358&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:32:43.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768408363 status=200 resp_size=6095
|
||
2026-01-15 00:32:43.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408363&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:32:46.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768408365 status=200 resp_size=4972
|
||
2026-01-15 00:32:46.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408366&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:32:51.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768408371 status=200 resp_size=5147
|
||
2026-01-15 00:32:51.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408371&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 00:33:01.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768408381 status=200 resp_size=5806
|
||
2026-01-15 00:33:02.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408381&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:33:09.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768408389 status=200 resp_size=6101
|
||
2026-01-15 00:33:09.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408389&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:33:13.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768408393 status=200 resp_size=5158
|
||
2026-01-15 00:33:13.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408393&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:33:20.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768408400 status=200 resp_size=6401
|
||
2026-01-15 00:33:21.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408400&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:33:29.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768408408 status=200 resp_size=4991
|
||
2026-01-15 00:33:29.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408409&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 00:33:31.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768408411 status=200 resp_size=6117
|
||
2026-01-15 00:33:31.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408411&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:33:33.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768408412 status=200 resp_size=4978
|
||
2026-01-15 00:33:33.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408413&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:33:40.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768408419 status=200 resp_size=6793
|
||
2026-01-15 00:33:40.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408420&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:33:45.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768408424 status=200 resp_size=5111
|
||
2026-01-15 00:33:45.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408425&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:33:56.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768408434 status=200 resp_size=6108
|
||
2026-01-15 00:33:56.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408436&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:33:58.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768408438 status=200 resp_size=5026
|
||
2026-01-15 00:33:59.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408438&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:33:59.001 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:34:04.964 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:34:04.964 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 00:34:07.277 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.30 秒后继续...
|
||
2026-01-15 00:34:07.277 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 00:34:07.277 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:34:07.286 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:34:07.961 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:34:09.125 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:34:11.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:34:11.276 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:34:11.779 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408447 status=200 resp_size=143024
|
||
2026-01-15 00:34:11.779 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:34:12.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768408451 status=200 resp_size=6546
|
||
2026-01-15 00:34:12.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408452&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 00:34:21.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job×tamp=1768408461 status=200 resp_size=5355
|
||
2026-01-15 00:34:22.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408461&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
|
||
2026-01-15 00:34:27.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768408467 status=200 resp_size=6109
|
||
2026-01-15 00:34:27.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408467&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:34:30.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768408470 status=200 resp_size=4859
|
||
2026-01-15 00:34:31.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408470&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:34:37.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768408476 status=200 resp_size=6285
|
||
2026-01-15 00:34:37.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408477&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 00:34:41.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768408481 status=200 resp_size=7170
|
||
2026-01-15 00:34:41.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408481&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 00:34:47.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768408487 status=200 resp_size=6115
|
||
2026-01-15 00:34:48.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408487&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:34:51.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768408491 status=200 resp_size=5992
|
||
2026-01-15 00:34:51.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408491&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 00:34:56.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768408496 status=200 resp_size=6873
|
||
2026-01-15 00:34:56.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408496&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:34:58.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768408497 status=200 resp_size=4833
|
||
2026-01-15 00:34:58.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408498&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 00:35:01.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768408500 status=200 resp_size=6044
|
||
2026-01-15 00:35:01.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408501&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:35:07.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768408507 status=200 resp_size=7131
|
||
2026-01-15 00:35:07.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408507&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 00:35:17.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768408516 status=200 resp_size=6770
|
||
2026-01-15 00:35:17.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408517&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 00:35:26.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768408525 status=200 resp_size=5688
|
||
2026-01-15 00:35:26.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408526&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:35:35.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768408534 status=200 resp_size=6107
|
||
2026-01-15 00:35:35.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408535&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:35:38.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768408538 status=200 resp_size=5215
|
||
2026-01-15 00:35:39.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408538&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 00:35:48.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768408548 status=200 resp_size=6794
|
||
2026-01-15 00:35:49.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408548&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 00:35:53.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768408553 status=200 resp_size=6749
|
||
2026-01-15 00:35:53.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408553&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 00:36:00.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768408559 status=200 resp_size=6113
|
||
2026-01-15 00:36:00.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408560&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:36:03.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768408563 status=200 resp_size=4990
|
||
2026-01-15 00:36:03.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408563&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 00:36:03.857 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:36:09.965 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:36:09.965 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 00:36:11.579 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.60 秒后继续...
|
||
2026-01-15 00:36:11.579 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 00:36:11.579 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:36:11.597 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=商丘, 工作类型=8305
|
||
2026-01-15 00:36:12.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:36:13.355 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:36:15.505 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:36:15.505 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:36:15.976 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408571 status=200 resp_size=113825
|
||
2026-01-15 00:36:15.976 | WARNING | __main__:get_recommend_jobs:745 - 第 26 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:36:15.976 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 16) | API返回totalCount: 517 (原始值: 517) | 地区: 商丘(商丘) | 职能: 投资者关系(8305)
|
||
2026-01-15 00:36:16.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job×tamp=1768408575 status=200 resp_size=4679
|
||
2026-01-15 00:36:16.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408576&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
|
||
2026-01-15 00:36:21.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768408581 status=200 resp_size=6107
|
||
2026-01-15 00:36:21.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408581&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:36:31.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768408590 status=200 resp_size=6544
|
||
2026-01-15 00:36:31.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408591&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 00:36:33.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768408593 status=200 resp_size=7105
|
||
2026-01-15 00:36:34.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408593&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 00:36:38.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768408598 status=200 resp_size=6531
|
||
2026-01-15 00:36:38.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408598&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 00:36:47.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768408606 status=200 resp_size=6109
|
||
2026-01-15 00:36:47.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408607&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:36:48.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768408608 status=200 resp_size=4704
|
||
2026-01-15 00:36:48.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408608&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 00:36:59.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768408618 status=200 resp_size=6427
|
||
2026-01-15 00:36:59.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408619&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 00:37:02.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768408622 status=200 resp_size=5737
|
||
2026-01-15 00:37:02.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408622&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 00:37:06.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768408625 status=200 resp_size=6111
|
||
2026-01-15 00:37:06.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408626&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:37:15.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768408635 status=200 resp_size=5499
|
||
2026-01-15 00:37:16.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408635&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 00:37:21.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768408640 status=200 resp_size=5880
|
||
2026-01-15 00:37:21.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408641&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 00:37:30.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768408649 status=200 resp_size=6122
|
||
2026-01-15 00:37:30.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408650&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 00:37:41.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768408658 status=200 resp_size=5903
|
||
2026-01-15 00:37:42.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408661&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 00:37:49.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768408668 status=200 resp_size=5129
|
||
2026-01-15 00:37:49.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408669&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 00:37:57.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768408677 status=200 resp_size=5241
|
||
2026-01-15 00:37:57.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408677&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 00:37:57.877 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 16
|
||
2026-01-15 00:38:02.679 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 16, 响应大小: 113 字节
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/505),提前结束爬取
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 503 条
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 14 条
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 505 条
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 商丘(商丘)
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 投资者关系(8305)
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.60% (503/505)
|
||
2026-01-15 00:38:02.679 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(503) < API返回总数(505),可能存在分页问题或数据过滤
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 00:38:02.679 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 503 条记录)
|
||
2026-01-15 00:38:02.679 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 503 个职位
|
||
2026-01-15 00:38:02.679 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 00:38:10.908 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:38:10.918 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:38:11.515 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 00:38:11.515 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 00:38:11.515 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:38:11.546 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:38:12.763 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:38:13.926 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:38:16.107 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:38:16.107 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:38:16.627 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408691 status=200 resp_size=114782
|
||
2026-01-15 00:38:16.627 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:38:16.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768408696 status=200 resp_size=4330
|
||
2026-01-15 00:38:17.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408696&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 00:38:23.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768408702 status=200 resp_size=5180
|
||
2026-01-15 00:38:23.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408703&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 00:38:32.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768408711 status=200 resp_size=5575
|
||
2026-01-15 00:38:32.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408712&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 00:38:45.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768408720 status=200 resp_size=5000
|
||
2026-01-15 00:38:45.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408725&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 00:38:49.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768408728 status=200 resp_size=5029
|
||
2026-01-15 00:38:50.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408729&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 00:38:54.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768408734 status=200 resp_size=5542
|
||
2026-01-15 00:38:55.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408734&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 00:39:03.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768408742 status=200 resp_size=5626
|
||
2026-01-15 00:39:03.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408743&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 00:39:13.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768408753 status=200 resp_size=6579
|
||
2026-01-15 00:39:14.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408753&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 00:39:20.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768408759 status=200 resp_size=5714
|
||
2026-01-15 00:39:20.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408760&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 00:39:22.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768408762 status=200 resp_size=5709
|
||
2026-01-15 00:39:22.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408762&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 00:39:32.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768408772 status=200 resp_size=6192
|
||
2026-01-15 00:39:32.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408772&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 00:39:35.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768408774 status=200 resp_size=6192
|
||
2026-01-15 00:39:35.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408775&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 00:39:39.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768408779 status=200 resp_size=5082
|
||
2026-01-15 00:39:39.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408779&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:39:44.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768408784 status=200 resp_size=5890
|
||
2026-01-15 00:39:44.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408784&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:39:48.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768408788 status=200 resp_size=5726
|
||
2026-01-15 00:39:48.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408788&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 00:39:51.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768408791 status=200 resp_size=4892
|
||
2026-01-15 00:39:52.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408791&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 00:40:00.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768408800 status=200 resp_size=4913
|
||
2026-01-15 00:40:01.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408800&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 00:40:09.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768408808 status=200 resp_size=5431
|
||
2026-01-15 00:40:09.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408809&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 00:40:17.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768408816 status=200 resp_size=6023
|
||
2026-01-15 00:40:18.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408817&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:40:25.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768408825 status=200 resp_size=6048
|
||
2026-01-15 00:40:26.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408825&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:40:26.193 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:40:26.523 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:40:26.523 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 00:40:26.523 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 00:40:35.352 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.82 秒后继续...
|
||
2026-01-15 00:40:35.352 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 00:40:35.352 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:40:35.380 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:40:35.961 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:40:37.090 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:40:39.227 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:40:39.227 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:40:39.651 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408835 status=200 resp_size=111557
|
||
2026-01-15 00:40:39.651 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:40:39.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768408839 status=200 resp_size=4954
|
||
2026-01-15 00:40:40.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408839&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 00:40:46.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768408845 status=200 resp_size=5667
|
||
2026-01-15 00:40:46.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408846&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 00:40:48.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768408847 status=200 resp_size=5721
|
||
2026-01-15 00:40:48.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408848&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 00:40:56.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768408853 status=200 resp_size=5573
|
||
2026-01-15 00:40:56.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408856&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 00:41:06.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768408865 status=200 resp_size=4992
|
||
2026-01-15 00:41:06.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408866&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:41:09.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768408869 status=200 resp_size=6314
|
||
2026-01-15 00:41:09.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408869&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 00:41:16.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768408875 status=200 resp_size=6787
|
||
2026-01-15 00:41:16.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408876&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 00:41:23.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768408882 status=200 resp_size=5480
|
||
2026-01-15 00:41:23.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408883&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 00:41:29.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768408889 status=200 resp_size=5976
|
||
2026-01-15 00:41:29.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408889&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 00:41:37.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768408897 status=200 resp_size=5184
|
||
2026-01-15 00:41:37.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408897&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 00:41:39.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768408898 status=200 resp_size=6134
|
||
2026-01-15 00:41:39.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408899&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 00:41:41.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768408901 status=200 resp_size=5587
|
||
2026-01-15 00:41:41.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408901&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 00:41:42.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768408902 status=200 resp_size=6399
|
||
2026-01-15 00:41:42.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408902&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:41:51.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768408910 status=200 resp_size=5110
|
||
2026-01-15 00:41:51.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408911&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 00:41:58.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768408917 status=200 resp_size=5940
|
||
2026-01-15 00:41:58.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408918&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 00:42:09.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768408928 status=200 resp_size=5601
|
||
2026-01-15 00:42:09.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408929&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:42:14.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768408934 status=200 resp_size=6095
|
||
2026-01-15 00:42:14.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408934&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 00:42:20.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768408939 status=200 resp_size=5374
|
||
2026-01-15 00:42:20.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408940&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:42:22.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768408942 status=200 resp_size=5486
|
||
2026-01-15 00:42:23.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408942&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 00:42:24.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768408944 status=200 resp_size=5596
|
||
2026-01-15 00:42:24.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408944&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 00:42:24.526 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:42:30.355 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:42:30.355 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 00:42:35.335 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.98 秒后继续...
|
||
2026-01-15 00:42:35.335 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 00:42:35.335 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:42:35.363 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:42:35.850 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:42:36.980 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:42:39.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:42:39.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:42:39.622 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768408955 status=200 resp_size=109526
|
||
2026-01-15 00:42:39.622 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:42:39.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768408959 status=200 resp_size=5974
|
||
2026-01-15 00:42:39.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408959&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:42:46.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768408965 status=200 resp_size=5682
|
||
2026-01-15 00:42:46.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408966&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:42:48.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768408968 status=200 resp_size=5486
|
||
2026-01-15 00:42:48.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408968&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 00:42:51.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768408971 status=200 resp_size=6076
|
||
2026-01-15 00:42:51.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408971&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 00:42:54.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768408973 status=200 resp_size=5524
|
||
2026-01-15 00:42:54.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408974&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 00:42:55.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768408975 status=200 resp_size=5641
|
||
2026-01-15 00:42:56.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408975&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 00:43:05.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768408982 status=200 resp_size=5513
|
||
2026-01-15 00:43:05.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408985&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 00:43:07.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768408986 status=200 resp_size=6285
|
||
2026-01-15 00:43:07.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408987&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 00:43:10.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768408989 status=200 resp_size=7756
|
||
2026-01-15 00:43:10.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408990&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 00:43:19.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768408998 status=200 resp_size=5127
|
||
2026-01-15 00:43:19.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768408999&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 00:43:21.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768409001 status=200 resp_size=5182
|
||
2026-01-15 00:43:22.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409001&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 00:43:31.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768409010 status=200 resp_size=5968
|
||
2026-01-15 00:43:31.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409011&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 00:43:38.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768409018 status=200 resp_size=5407
|
||
2026-01-15 00:43:38.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409018&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 00:43:42.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768409022 status=200 resp_size=5328
|
||
2026-01-15 00:43:43.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409022&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:43:46.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768409026 status=200 resp_size=5718
|
||
2026-01-15 00:43:46.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409026&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 00:43:56.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768409035 status=200 resp_size=5729
|
||
2026-01-15 00:43:56.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409036&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:44:04.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768409044 status=200 resp_size=5845
|
||
2026-01-15 00:44:05.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409044&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:44:09.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768409049 status=200 resp_size=5222
|
||
2026-01-15 00:44:10.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409049&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 00:44:17.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768409056 status=200 resp_size=5711
|
||
2026-01-15 00:44:17.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409057&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 00:44:27.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768409066 status=200 resp_size=6015
|
||
2026-01-15 00:44:27.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409067&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 00:44:27.215 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:44:27.577 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:44:27.577 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 00:44:32.996 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.41 秒后继续...
|
||
2026-01-15 00:44:32.996 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 00:44:32.996 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:44:33.012 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:44:33.687 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:44:34.849 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:44:37.001 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:44:37.001 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:44:37.488 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409073 status=200 resp_size=118111
|
||
2026-01-15 00:44:37.488 | WARNING | __main__:get_recommend_jobs:745 - 第 4 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:44:37.488 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:44:37.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768409077 status=200 resp_size=5245
|
||
2026-01-15 00:44:37.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409077&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 00:44:44.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768409083 status=200 resp_size=6139
|
||
2026-01-15 00:44:44.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409084&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 00:44:54.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768409093 status=200 resp_size=6647
|
||
2026-01-15 00:44:54.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409094&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 00:44:59.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768409099 status=200 resp_size=5677
|
||
2026-01-15 00:44:59.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409099&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 00:45:03.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768409103 status=200 resp_size=6444
|
||
2026-01-15 00:45:03.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409103&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 00:45:08.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768409108 status=200 resp_size=5823
|
||
2026-01-15 00:45:08.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409108&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:45:18.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768409118 status=200 resp_size=6462
|
||
2026-01-15 00:45:19.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409118&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:45:20.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768409120 status=200 resp_size=6318
|
||
2026-01-15 00:45:21.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409120&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 00:45:24.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768409124 status=200 resp_size=5783
|
||
2026-01-15 00:45:25.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409124&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:45:27.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768409127 status=200 resp_size=5799
|
||
2026-01-15 00:45:28.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409127&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:45:29.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768409129 status=200 resp_size=5955
|
||
2026-01-15 00:45:29.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409129&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:45:32.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768409132 status=200 resp_size=5613
|
||
2026-01-15 00:45:33.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409132&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 00:45:39.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768409139 status=200 resp_size=6388
|
||
2026-01-15 00:45:40.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409139&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 00:45:49.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768409148 status=200 resp_size=6039
|
||
2026-01-15 00:45:49.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409149&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:45:54.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768409153 status=200 resp_size=6507
|
||
2026-01-15 00:45:54.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409154&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 00:46:00.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768409160 status=200 resp_size=6511
|
||
2026-01-15 00:46:01.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409160&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:46:03.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768409162 status=200 resp_size=5930
|
||
2026-01-15 00:46:03.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409163&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:46:07.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768409167 status=200 resp_size=4058
|
||
2026-01-15 00:46:07.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409167&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 00:46:18.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768409177 status=200 resp_size=5222
|
||
2026-01-15 00:46:18.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409178&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:46:18.232 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 00:46:23.869 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 00:46:23.869 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 00:46:27.124 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.24 秒后继续...
|
||
2026-01-15 00:46:27.124 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 00:46:27.124 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:46:27.152 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:46:27.655 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:46:28.754 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:46:30.858 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:46:30.858 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:46:31.376 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409187 status=200 resp_size=136257
|
||
2026-01-15 00:46:31.376 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:46:31.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768409191 status=200 resp_size=7311
|
||
2026-01-15 00:46:31.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409191&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-15 00:46:35.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768409195 status=200 resp_size=6173
|
||
2026-01-15 00:46:35.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409195&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 00:46:46.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768409205 status=200 resp_size=5624
|
||
2026-01-15 00:46:46.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409206&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:46:48.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768409208 status=200 resp_size=6121
|
||
2026-01-15 00:46:48.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409208&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:46:59.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768409218 status=200 resp_size=7499
|
||
2026-01-15 00:46:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409219&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 00:47:08.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768409226 status=200 resp_size=5878
|
||
2026-01-15 00:47:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409228&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 00:47:12.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768409231 status=200 resp_size=6051
|
||
2026-01-15 00:47:12.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409232&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 00:47:18.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768409238 status=200 resp_size=5451
|
||
2026-01-15 00:47:18.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409238&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 00:47:24.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768409244 status=200 resp_size=6422
|
||
2026-01-15 00:47:25.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409244&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 00:47:28.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768409248 status=200 resp_size=7534
|
||
2026-01-15 00:47:28.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409248&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 00:47:33.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768409253 status=200 resp_size=5756
|
||
2026-01-15 00:47:33.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409253&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:47:38.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768409257 status=200 resp_size=6431
|
||
2026-01-15 00:47:38.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409258&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 00:47:47.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768409267 status=200 resp_size=8364
|
||
2026-01-15 00:47:48.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409267&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-15 00:47:57.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768409276 status=200 resp_size=5876
|
||
2026-01-15 00:47:57.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409277&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 00:48:03.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768409283 status=200 resp_size=5628
|
||
2026-01-15 00:48:04.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409283&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-15 00:48:06.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768409286 status=200 resp_size=6058
|
||
2026-01-15 00:48:06.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409286&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:48:14.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768409294 status=200 resp_size=6856
|
||
2026-01-15 00:48:15.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409294&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 00:48:25.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768409304 status=200 resp_size=6718
|
||
2026-01-15 00:48:25.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409305&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 00:48:33.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768409312 status=200 resp_size=6573
|
||
2026-01-15 00:48:33.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409313&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 00:48:43.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768409322 status=200 resp_size=6473
|
||
2026-01-15 00:48:43.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409323&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:48:43.433 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:48:49.866 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:48:49.869 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 00:48:52.922 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.05 秒后继续...
|
||
2026-01-15 00:48:52.922 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 00:48:52.922 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:48:52.951 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:48:53.595 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:48:54.757 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:48:56.939 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:48:56.939 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:48:57.442 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409332 status=200 resp_size=150491
|
||
2026-01-15 00:48:57.442 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:48:57.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768409337 status=200 resp_size=6715
|
||
2026-01-15 00:48:57.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409337&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 00:49:07.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768409346 status=200 resp_size=5857
|
||
2026-01-15 00:49:07.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409347&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 00:49:17.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768409357 status=200 resp_size=5211
|
||
2026-01-15 00:49:17.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409357&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 00:49:28.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768409367 status=200 resp_size=6024
|
||
2026-01-15 00:49:28.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409368&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:49:38.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768409377 status=200 resp_size=5942
|
||
2026-01-15 00:49:38.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409378&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 00:49:43.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768409383 status=200 resp_size=8574
|
||
2026-01-15 00:49:43.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409383&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 00:49:52.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768409392 status=200 resp_size=6423
|
||
2026-01-15 00:49:53.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409392&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 00:49:59.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768409398 status=200 resp_size=5421
|
||
2026-01-15 00:49:59.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409399&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:50:00.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768409400 status=200 resp_size=7551
|
||
2026-01-15 00:50:00.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409400&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 00:50:03.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768409402 status=200 resp_size=5784
|
||
2026-01-15 00:50:03.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409403&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 00:50:07.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768409406 status=200 resp_size=5306
|
||
2026-01-15 00:50:07.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409407&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 00:50:11.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768409411 status=200 resp_size=5687
|
||
2026-01-15 00:50:11.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:50:17.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768409416 status=200 resp_size=7182
|
||
2026-01-15 00:50:17.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409417&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 00:50:25.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768409424 status=200 resp_size=7262
|
||
2026-01-15 00:50:25.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409425&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 00:50:29.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768409429 status=200 resp_size=6343
|
||
2026-01-15 00:50:30.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409429&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 00:50:36.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768409436 status=200 resp_size=6958
|
||
2026-01-15 00:50:37.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409436&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:50:41.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768409440 status=200 resp_size=5655
|
||
2026-01-15 00:50:41.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409441&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 00:50:45.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768409445 status=200 resp_size=8225
|
||
2026-01-15 00:50:45.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409445&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 00:50:55.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768409455 status=200 resp_size=7119
|
||
2026-01-15 00:50:56.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409455&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 00:51:01.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768409460 status=200 resp_size=6552
|
||
2026-01-15 00:51:01.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409461&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:51:01.438 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:51:08.221 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:51:08.221 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 00:51:17.162 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.93 秒后继续...
|
||
2026-01-15 00:51:17.162 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 00:51:17.162 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:51:17.188 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:51:17.921 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:51:19.070 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:51:21.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:51:21.285 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:51:21.819 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409477 status=200 resp_size=146853
|
||
2026-01-15 00:51:21.819 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:51:22.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768409481 status=200 resp_size=5588
|
||
2026-01-15 00:51:22.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409482&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 00:51:33.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768409490 status=200 resp_size=7967
|
||
2026-01-15 00:51:33.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409493&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 00:51:41.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768409500 status=200 resp_size=6714
|
||
2026-01-15 00:51:41.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409501&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 00:51:46.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768409506 status=200 resp_size=5497
|
||
2026-01-15 00:51:47.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409506&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:51:51.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768409511 status=200 resp_size=5775
|
||
2026-01-15 00:51:52.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409511&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 00:51:53.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768409513 status=200 resp_size=6684
|
||
2026-01-15 00:51:53.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409513&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 00:52:00.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768409519 status=200 resp_size=13102
|
||
2026-01-15 00:52:00.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409520&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 00:52:10.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768409529 status=200 resp_size=6689
|
||
2026-01-15 00:52:10.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:52:18.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768409537 status=200 resp_size=5128
|
||
2026-01-15 00:52:19.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409538&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 00:52:20.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768409540 status=200 resp_size=6362
|
||
2026-01-15 00:52:20.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409540&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 00:52:29.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768409548 status=200 resp_size=6529
|
||
2026-01-15 00:52:29.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409549&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 00:52:32.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768409552 status=200 resp_size=6390
|
||
2026-01-15 00:52:33.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409552&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:52:36.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768409556 status=200 resp_size=7130
|
||
2026-01-15 00:52:37.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409556&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 00:52:45.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768409564 status=200 resp_size=7415
|
||
2026-01-15 00:52:45.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409565&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 00:52:49.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768409569 status=200 resp_size=5152
|
||
2026-01-15 00:52:49.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409569&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 00:52:55.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768409575 status=200 resp_size=6254
|
||
2026-01-15 00:52:55.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409575&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:53:03.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768409582 status=200 resp_size=5877
|
||
2026-01-15 00:53:03.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409583&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 00:53:09.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768409588 status=200 resp_size=6039
|
||
2026-01-15 00:53:09.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409589&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 00:53:18.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768409597 status=200 resp_size=5098
|
||
2026-01-15 00:53:18.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409598&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 00:53:19.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768409599 status=200 resp_size=7126
|
||
2026-01-15 00:53:19.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409599&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:53:19.857 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:53:26.411 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:53:26.411 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 00:53:32.448 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.03 秒后继续...
|
||
2026-01-15 00:53:32.448 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 00:53:32.448 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:53:32.467 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:53:33.219 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:53:34.382 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:53:36.565 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:53:36.565 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:53:37.144 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409612 status=200 resp_size=147387
|
||
2026-01-15 00:53:37.146 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:53:37.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768409617 status=200 resp_size=5711
|
||
2026-01-15 00:53:37.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409617&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 00:53:41.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768409621 status=200 resp_size=6970
|
||
2026-01-15 00:53:41.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409621&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 00:53:50.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768409628 status=200 resp_size=5109
|
||
2026-01-15 00:53:50.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409630&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 00:53:57.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768409637 status=200 resp_size=6226
|
||
2026-01-15 00:53:57.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409637&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:54:00.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768409640 status=200 resp_size=7717
|
||
2026-01-15 00:54:00.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409640&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 00:54:10.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768409649 status=200 resp_size=8734
|
||
2026-01-15 00:54:10.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409650&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 00:54:17.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768409657 status=200 resp_size=8808
|
||
2026-01-15 00:54:18.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409657&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:54:24.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768409663 status=200 resp_size=5686
|
||
2026-01-15 00:54:24.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409664&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-15 00:54:29.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768409669 status=200 resp_size=6558
|
||
2026-01-15 00:54:29.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409669&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 00:54:37.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768409676 status=200 resp_size=5533
|
||
2026-01-15 00:54:37.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409677&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 00:54:46.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768409685 status=200 resp_size=5920
|
||
2026-01-15 00:54:46.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409686&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:54:55.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768409694 status=200 resp_size=6522
|
||
2026-01-15 00:54:56.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409695&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 00:55:05.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768409705 status=200 resp_size=5458
|
||
2026-01-15 00:55:05.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409705&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 00:55:15.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768409714 status=200 resp_size=7237
|
||
2026-01-15 00:55:15.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409715&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 00:55:24.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768409723 status=200 resp_size=6445
|
||
2026-01-15 00:55:24.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409724&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:55:31.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768409730 status=200 resp_size=5342
|
||
2026-01-15 00:55:31.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409731&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 00:55:42.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768409741 status=200 resp_size=5431
|
||
2026-01-15 00:55:42.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409742&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 00:55:48.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768409747 status=200 resp_size=7607
|
||
2026-01-15 00:55:48.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409748&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 00:55:57.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768409756 status=200 resp_size=4995
|
||
2026-01-15 00:55:57.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409757&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:56:00.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768409759 status=200 resp_size=7194
|
||
2026-01-15 00:56:00.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409760&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 00:56:00.295 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:56:06.608 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:56:06.608 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 00:56:15.185 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.57 秒后继续...
|
||
2026-01-15 00:56:15.185 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 00:56:15.185 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:56:15.213 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:56:16.014 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:56:17.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:56:19.393 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:56:19.408 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:56:19.942 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409775 status=200 resp_size=149280
|
||
2026-01-15 00:56:19.942 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:56:20.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768409779 status=200 resp_size=6416
|
||
2026-01-15 00:56:20.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409780&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 00:56:27.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768409787 status=200 resp_size=6501
|
||
2026-01-15 00:56:28.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409787&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:56:37.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768409796 status=200 resp_size=6646
|
||
2026-01-15 00:56:37.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409797&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 00:56:48.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768409807 status=200 resp_size=5473
|
||
2026-01-15 00:56:48.387 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409808&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 00:56:52.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768409812 status=200 resp_size=5678
|
||
2026-01-15 00:56:52.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409812&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:56:54.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768409813 status=200 resp_size=6449
|
||
2026-01-15 00:56:54.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409814&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 00:57:03.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768409822 status=200 resp_size=5925
|
||
2026-01-15 00:57:03.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409823&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 00:57:05.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768409825 status=200 resp_size=7750
|
||
2026-01-15 00:57:05.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409825&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 00:57:12.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768409832 status=200 resp_size=8457
|
||
2026-01-15 00:57:12.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409832&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:57:23.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768409842 status=200 resp_size=7971
|
||
2026-01-15 00:57:23.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409843&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 00:57:32.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768409851 status=200 resp_size=8313
|
||
2026-01-15 00:57:32.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409852&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 00:57:40.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768409860 status=200 resp_size=5424
|
||
2026-01-15 00:57:41.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409860&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 00:57:44.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768409863 status=200 resp_size=6770
|
||
2026-01-15 00:57:44.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409864&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:57:48.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768409867 status=200 resp_size=8274
|
||
2026-01-15 00:57:48.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409868&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 00:57:57.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768409876 status=200 resp_size=8701
|
||
2026-01-15 00:57:58.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409877&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 00:58:07.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768409886 status=200 resp_size=5378
|
||
2026-01-15 00:58:07.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409887&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 00:58:14.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768409893 status=200 resp_size=5414
|
||
2026-01-15 00:58:14.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409894&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:58:18.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768409898 status=200 resp_size=5253
|
||
2026-01-15 00:58:18.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409898&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 00:58:24.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768409904 status=200 resp_size=6080
|
||
2026-01-15 00:58:25.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409904&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 00:58:31.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768409910 status=200 resp_size=5916
|
||
2026-01-15 00:58:31.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409911&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 00:58:31.855 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 00:58:38.324 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 00:58:38.324 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 00:58:48.272 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.94 秒后继续...
|
||
2026-01-15 00:58:48.272 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 00:58:48.272 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 00:58:48.296 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 00:58:49.088 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:58:50.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:58:52.460 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 00:58:52.460 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 00:58:52.948 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768409928 status=200 resp_size=130881
|
||
2026-01-15 00:58:52.948 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 00:58:52.948 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 00:58:53.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768409932 status=200 resp_size=4916
|
||
2026-01-15 00:58:53.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409933&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 00:58:59.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768409938 status=200 resp_size=5446
|
||
2026-01-15 00:58:59.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409939&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-15 00:59:02.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768409942 status=200 resp_size=6119
|
||
2026-01-15 00:59:02.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409942&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:59:06.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768409946 status=200 resp_size=6053
|
||
2026-01-15 00:59:06.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409946&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 00:59:16.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768409955 status=200 resp_size=6494
|
||
2026-01-15 00:59:16.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409956&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 00:59:20.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768409960 status=200 resp_size=6226
|
||
2026-01-15 00:59:21.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409960&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 00:59:31.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768409971 status=200 resp_size=6284
|
||
2026-01-15 00:59:32.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409971&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:59:40.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768409979 status=200 resp_size=6176
|
||
2026-01-15 00:59:40.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409980&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 00:59:42.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768409982 status=200 resp_size=5673
|
||
2026-01-15 00:59:42.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409982&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 00:59:45.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768409985 status=200 resp_size=6731
|
||
2026-01-15 00:59:45.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409985&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 00:59:53.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768409992 status=200 resp_size=5862
|
||
2026-01-15 00:59:53.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409993&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 00:59:54.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768409994 status=200 resp_size=5378
|
||
2026-01-15 00:59:54.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409994&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 00:59:57.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768409996 status=200 resp_size=5575
|
||
2026-01-15 00:59:57.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409997&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 00:59:58.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768409998 status=200 resp_size=6187
|
||
2026-01-15 00:59:59.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768409998&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 01:00:05.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768410004 status=200 resp_size=5792
|
||
2026-01-15 01:00:05.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410005&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:00:13.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768410012 status=200 resp_size=5731
|
||
2026-01-15 01:00:14.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410013&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 01:00:19.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768410018 status=200 resp_size=7075
|
||
2026-01-15 01:00:19.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410019&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 01:00:25.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768410025 status=200 resp_size=6530
|
||
2026-01-15 01:00:25.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410025&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:00:35.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768410034 status=200 resp_size=8973
|
||
2026-01-15 01:00:36.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410035&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 01:00:36.338 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:00:36.730 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:00:36.730 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 01:00:44.199 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.45 秒后继续...
|
||
2026-01-15 01:00:44.199 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 01:00:44.199 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:00:44.235 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:00:45.004 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:00:46.198 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:00:48.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:00:48.397 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:00:48.916 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410044 status=200 resp_size=144107
|
||
2026-01-15 01:00:48.916 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:00:48.916 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:00:49.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768410048 status=200 resp_size=8559
|
||
2026-01-15 01:00:49.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410049&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 01:00:55.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768410055 status=200 resp_size=6688
|
||
2026-01-15 01:00:56.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410055&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 01:01:00.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768410060 status=200 resp_size=5982
|
||
2026-01-15 01:01:00.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410060&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 01:01:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768410068 status=200 resp_size=7919
|
||
2026-01-15 01:01:08.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410068&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 01:01:18.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768410077 status=200 resp_size=7693
|
||
2026-01-15 01:01:18.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410078&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 01:01:25.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768410084 status=200 resp_size=5259
|
||
2026-01-15 01:01:25.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410085&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 01:01:30.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768410089 status=200 resp_size=6660
|
||
2026-01-15 01:01:30.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410090&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 01:01:39.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768410098 status=200 resp_size=5390
|
||
2026-01-15 01:01:40.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410099&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 01:01:46.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768410105 status=200 resp_size=7952
|
||
2026-01-15 01:01:46.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410106&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 01:01:53.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768410112 status=200 resp_size=6635
|
||
2026-01-15 01:01:53.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410113&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 01:02:03.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768410122 status=200 resp_size=5277
|
||
2026-01-15 01:02:03.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410123&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 01:02:09.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768410129 status=200 resp_size=7175
|
||
2026-01-15 01:02:09.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410129&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 01:02:20.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768410139 status=200 resp_size=6284
|
||
2026-01-15 01:02:21.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410140&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:02:26.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768410145 status=200 resp_size=5924
|
||
2026-01-15 01:02:26.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410146&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 01:02:36.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768410155 status=200 resp_size=6003
|
||
2026-01-15 01:02:37.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410156&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 01:02:39.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768410158 status=200 resp_size=5672
|
||
2026-01-15 01:02:39.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410159&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 01:02:48.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768410167 status=200 resp_size=9402
|
||
2026-01-15 01:02:48.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410168&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 01:02:52.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768410172 status=200 resp_size=6867
|
||
2026-01-15 01:02:52.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410172&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:02:54.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768410174 status=200 resp_size=13285
|
||
2026-01-15 01:02:54.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410174&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 01:02:54.930 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:02:55.244 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:02:55.244 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 01:02:59.048 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.79 秒后继续...
|
||
2026-01-15 01:02:59.048 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 01:02:59.048 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:02:59.078 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:02:59.597 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:03:00.727 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:03:02.865 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:03:02.865 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:03:03.351 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410179 status=200 resp_size=127459
|
||
2026-01-15 01:03:03.351 | WARNING | __main__:get_recommend_jobs:745 - 第 12 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:03:03.351 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:03:03.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768410183 status=200 resp_size=6041
|
||
2026-01-15 01:03:03.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410183&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 01:03:10.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768410189 status=200 resp_size=5280
|
||
2026-01-15 01:03:10.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410190&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 01:03:13.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768410193 status=200 resp_size=8069
|
||
2026-01-15 01:03:13.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410193&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 01:03:21.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768410200 status=200 resp_size=6588
|
||
2026-01-15 01:03:21.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410201&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 01:03:24.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768410204 status=200 resp_size=6300
|
||
2026-01-15 01:03:24.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410204&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 01:03:33.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768410212 status=200 resp_size=6075
|
||
2026-01-15 01:03:33.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410213&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:03:41.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768410220 status=200 resp_size=4572
|
||
2026-01-15 01:03:41.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410221&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 01:03:52.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768410231 status=200 resp_size=4992
|
||
2026-01-15 01:03:52.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410232&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 01:03:55.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768410235 status=200 resp_size=7194
|
||
2026-01-15 01:03:56.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410235&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 01:04:05.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768410244 status=200 resp_size=5332
|
||
2026-01-15 01:04:05.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410245&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 01:04:14.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768410253 status=200 resp_size=5554
|
||
2026-01-15 01:04:14.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410254&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:04:20.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768410259 status=200 resp_size=5040
|
||
2026-01-15 01:04:21.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410260&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 01:04:29.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768410268 status=200 resp_size=6755
|
||
2026-01-15 01:04:29.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410269&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:04:37.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768410277 status=200 resp_size=5883
|
||
2026-01-15 01:04:38.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410277&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 01:04:40.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768410280 status=200 resp_size=5760
|
||
2026-01-15 01:04:40.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410280&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 01:04:47.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768410286 status=200 resp_size=6980
|
||
2026-01-15 01:04:47.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410287&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 01:04:50.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768410290 status=200 resp_size=5283
|
||
2026-01-15 01:04:50.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410290&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:04:57.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768410296 status=200 resp_size=5508
|
||
2026-01-15 01:04:57.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410297&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 01:05:03.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768410302 status=200 resp_size=4592
|
||
2026-01-15 01:05:03.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410303&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 01:05:03.428 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:05:03.729 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:05:03.729 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 01:05:05.164 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.43 秒后继续...
|
||
2026-01-15 01:05:05.165 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 01:05:05.165 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:05:05.181 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:05:05.637 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:05:06.783 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:05:08.889 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:05:08.889 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:05:09.313 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410305 status=200 resp_size=155905
|
||
2026-01-15 01:05:09.313 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:05:09.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768410309 status=200 resp_size=6659
|
||
2026-01-15 01:05:09.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410309&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:05:13.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768410312 status=200 resp_size=5165
|
||
2026-01-15 01:05:13.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410313&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 01:05:16.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768410315 status=200 resp_size=5570
|
||
2026-01-15 01:05:16.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410316&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 01:05:17.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768410317 status=200 resp_size=9108
|
||
2026-01-15 01:05:17.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410317&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 01:05:19.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768410319 status=200 resp_size=5688
|
||
2026-01-15 01:05:20.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410319&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 01:05:24.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768410324 status=200 resp_size=6380
|
||
2026-01-15 01:05:24.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410324&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 01:05:25.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768410325 status=200 resp_size=6612
|
||
2026-01-15 01:05:25.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410325&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 01:05:33.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768410332 status=200 resp_size=7975
|
||
2026-01-15 01:05:33.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410333&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 01:05:41.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768410340 status=200 resp_size=5984
|
||
2026-01-15 01:05:41.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410341&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 01:05:49.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768410348 status=200 resp_size=7243
|
||
2026-01-15 01:05:49.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410349&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 01:05:53.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768410353 status=200 resp_size=5582
|
||
2026-01-15 01:05:53.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410353&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 01:06:01.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768410360 status=200 resp_size=6935
|
||
2026-01-15 01:06:01.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410361&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 01:06:10.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768410370 status=200 resp_size=5924
|
||
2026-01-15 01:06:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410370&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 01:06:17.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768410376 status=200 resp_size=6027
|
||
2026-01-15 01:06:18.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410377&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 01:06:24.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768410383 status=200 resp_size=6856
|
||
2026-01-15 01:06:24.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410384&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 01:06:32.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768410391 status=200 resp_size=6028
|
||
2026-01-15 01:06:33.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410392&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:06:37.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768410397 status=200 resp_size=6111
|
||
2026-01-15 01:06:37.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410397&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 01:06:39.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768410399 status=200 resp_size=8782
|
||
2026-01-15 01:06:39.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410399&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 01:06:43.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768410402 status=200 resp_size=6694
|
||
2026-01-15 01:06:43.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410403&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 01:06:50.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768410409 status=200 resp_size=8655
|
||
2026-01-15 01:06:50.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410410&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 01:06:50.699 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:06:57.041 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:06:57.056 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 01:07:03.487 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.43 秒后继续...
|
||
2026-01-15 01:07:03.487 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 01:07:03.487 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:07:03.510 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:07:04.342 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:07:05.505 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:07:07.640 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:07:07.640 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:07:08.112 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410423 status=200 resp_size=130627
|
||
2026-01-15 01:07:08.112 | WARNING | __main__:get_recommend_jobs:745 - 第 14 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:07:08.112 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 516 (原始值: 516) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:07:08.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768410428 status=200 resp_size=7907
|
||
2026-01-15 01:07:08.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410428&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 01:07:11.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768410431 status=200 resp_size=5922
|
||
2026-01-15 01:07:12.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410431&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 01:07:16.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768410436 status=200 resp_size=5874
|
||
2026-01-15 01:07:16.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410436&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 01:07:26.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768410446 status=200 resp_size=6449
|
||
2026-01-15 01:07:27.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410446&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 01:07:31.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768410451 status=200 resp_size=7313
|
||
2026-01-15 01:07:32.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410451&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 01:07:40.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768410459 status=200 resp_size=6958
|
||
2026-01-15 01:07:40.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410460&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 01:07:50.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768410469 status=200 resp_size=5499
|
||
2026-01-15 01:07:50.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410470&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 01:07:56.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768410475 status=200 resp_size=5673
|
||
2026-01-15 01:07:56.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410476&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 01:08:00.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768410480 status=200 resp_size=7081
|
||
2026-01-15 01:08:00.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410480&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 01:08:07.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768410487 status=200 resp_size=7664
|
||
2026-01-15 01:08:08.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410487&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 01:08:18.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job×tamp=1768410497 status=200 resp_size=6150
|
||
2026-01-15 01:08:18.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410498&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
|
||
2026-01-15 01:08:21.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768410501 status=200 resp_size=6652
|
||
2026-01-15 01:08:22.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410501&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 01:08:32.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768410511 status=200 resp_size=4729
|
||
2026-01-15 01:08:32.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410512&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 01:08:35.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768410515 status=200 resp_size=4926
|
||
2026-01-15 01:08:35.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410515&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 01:08:42.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768410521 status=200 resp_size=4902
|
||
2026-01-15 01:08:42.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410522&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 01:08:51.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768410530 status=200 resp_size=7369
|
||
2026-01-15 01:08:51.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410531&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 01:08:59.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768410539 status=200 resp_size=4830
|
||
2026-01-15 01:08:59.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410539&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 01:09:06.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768410546 status=200 resp_size=5006
|
||
2026-01-15 01:09:07.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410546&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 01:09:16.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768410555 status=200 resp_size=5351
|
||
2026-01-15 01:09:16.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410556&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 01:09:16.678 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:09:22.319 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:09:22.319 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 01:09:25.860 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.54 秒后继续...
|
||
2026-01-15 01:09:25.860 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 01:09:25.860 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:09:25.880 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:09:26.634 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:09:27.812 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:09:29.997 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:09:29.997 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:09:30.624 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410565 status=200 resp_size=138078
|
||
2026-01-15 01:09:30.624 | WARNING | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:09:30.624 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:09:30.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768410570 status=200 resp_size=5240
|
||
2026-01-15 01:09:31.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410570&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 01:09:36.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768410576 status=200 resp_size=5282
|
||
2026-01-15 01:09:37.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410576&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 01:09:47.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768410586 status=200 resp_size=5232
|
||
2026-01-15 01:09:47.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410587&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 01:09:57.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768410596 status=200 resp_size=6946
|
||
2026-01-15 01:09:57.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410597&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 01:10:06.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768410605 status=200 resp_size=4956
|
||
2026-01-15 01:10:06.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410606&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:10:16.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768410615 status=200 resp_size=7382
|
||
2026-01-15 01:10:16.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410616&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 01:10:24.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768410624 status=200 resp_size=7331
|
||
2026-01-15 01:10:24.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410624&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 01:10:34.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768410634 status=200 resp_size=5087
|
||
2026-01-15 01:10:35.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410634&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 01:10:38.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768410638 status=200 resp_size=6551
|
||
2026-01-15 01:10:38.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410638&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 01:10:47.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768410646 status=200 resp_size=4515
|
||
2026-01-15 01:10:47.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410647&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 01:10:56.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768410655 status=200 resp_size=4865
|
||
2026-01-15 01:10:56.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410656&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 01:11:04.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768410664 status=200 resp_size=5494
|
||
2026-01-15 01:11:05.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410664&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 01:11:11.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768410670 status=200 resp_size=6572
|
||
2026-01-15 01:11:12.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410671&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 01:11:15.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768410675 status=200 resp_size=5670
|
||
2026-01-15 01:11:15.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410675&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 01:11:19.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768410678 status=200 resp_size=6137
|
||
2026-01-15 01:11:19.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410679&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 01:11:24.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768410684 status=200 resp_size=6303
|
||
2026-01-15 01:11:24.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410684&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 01:11:33.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768410692 status=200 resp_size=5465
|
||
2026-01-15 01:11:33.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410693&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 01:11:40.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768410700 status=200 resp_size=5725
|
||
2026-01-15 01:11:40.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410700&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 01:11:46.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768410706 status=200 resp_size=4737
|
||
2026-01-15 01:11:46.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410706&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 01:11:46.643 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:11:52.078 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:11:52.078 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 01:12:01.064 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.97 秒后继续...
|
||
2026-01-15 01:12:01.064 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 01:12:01.064 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:12:01.090 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:12:01.955 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:12:03.165 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:12:05.380 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:12:05.380 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:12:05.945 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410721 status=200 resp_size=134255
|
||
2026-01-15 01:12:05.945 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:12:06.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768410725 status=200 resp_size=4297
|
||
2026-01-15 01:12:06.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410726&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 01:12:15.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768410734 status=200 resp_size=5259
|
||
2026-01-15 01:12:15.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410735&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 01:12:24.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job×tamp=1768410743 status=200 resp_size=4786
|
||
2026-01-15 01:12:24.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410744&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 01:12:34.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768410754 status=200 resp_size=5742
|
||
2026-01-15 01:12:34.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410754&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 01:12:39.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768410759 status=200 resp_size=7248
|
||
2026-01-15 01:12:39.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410759&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 01:12:44.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768410764 status=200 resp_size=6326
|
||
2026-01-15 01:12:44.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410764&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 01:12:54.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768410773 status=200 resp_size=5466
|
||
2026-01-15 01:12:54.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410774&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 01:13:05.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768410784 status=200 resp_size=5037
|
||
2026-01-15 01:13:05.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410785&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 01:13:13.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768410792 status=200 resp_size=5631
|
||
2026-01-15 01:13:14.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410793&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 01:13:19.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768410798 status=200 resp_size=5979
|
||
2026-01-15 01:13:19.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410799&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 01:13:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768410805 status=200 resp_size=6291
|
||
2026-01-15 01:13:26.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410806&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 01:13:29.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768410809 status=200 resp_size=5973
|
||
2026-01-15 01:13:30.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410809&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 01:13:31.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768410811 status=200 resp_size=5927
|
||
2026-01-15 01:13:32.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410811&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 01:13:39.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768410818 status=200 resp_size=6295
|
||
2026-01-15 01:13:39.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410819&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 01:13:48.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768410827 status=200 resp_size=5174
|
||
2026-01-15 01:13:48.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410828&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 01:13:55.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768410834 status=200 resp_size=6666
|
||
2026-01-15 01:13:55.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410835&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 01:14:01.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768410841 status=200 resp_size=4654
|
||
2026-01-15 01:14:01.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410841&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 01:14:05.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768410845 status=200 resp_size=6133
|
||
2026-01-15 01:14:05.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410845&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 01:14:07.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768410847 status=200 resp_size=7057
|
||
2026-01-15 01:14:07.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410847&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 01:14:13.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768410853 status=200 resp_size=6546
|
||
2026-01-15 01:14:13.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410853&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 01:14:13.770 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:14:20.039 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:14:20.039 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 01:14:22.446 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.41 秒后继续...
|
||
2026-01-15 01:14:22.446 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 01:14:22.446 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:14:22.458 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:14:23.064 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:14:24.202 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:14:26.347 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:14:26.347 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:14:26.825 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410862 status=200 resp_size=121856
|
||
2026-01-15 01:14:26.825 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:14:26.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768410866 status=200 resp_size=4773
|
||
2026-01-15 01:14:27.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410866&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 01:14:36.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768410876 status=200 resp_size=5359
|
||
2026-01-15 01:14:37.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410876&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:14:40.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768410880 status=200 resp_size=6325
|
||
2026-01-15 01:14:40.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410880&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 01:14:50.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768410889 status=200 resp_size=6073
|
||
2026-01-15 01:14:50.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410890&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 01:14:52.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768410892 status=200 resp_size=5106
|
||
2026-01-15 01:14:52.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410892&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 01:15:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768410900 status=200 resp_size=5306
|
||
2026-01-15 01:15:01.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410900&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 01:15:03.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768410903 status=200 resp_size=5111
|
||
2026-01-15 01:15:04.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410903&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 01:15:10.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768410910 status=200 resp_size=5915
|
||
2026-01-15 01:15:11.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410910&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 01:15:18.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768410917 status=200 resp_size=5282
|
||
2026-01-15 01:15:18.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410918&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 01:15:26.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job×tamp=1768410926 status=200 resp_size=7722
|
||
2026-01-15 01:15:27.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410926&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 01:15:29.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768410929 status=200 resp_size=4719
|
||
2026-01-15 01:15:30.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410929&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 01:15:34.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768410933 status=200 resp_size=5693
|
||
2026-01-15 01:15:34.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410934&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:15:37.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768410936 status=200 resp_size=7688
|
||
2026-01-15 01:15:37.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410937&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 01:15:39.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768410939 status=200 resp_size=5294
|
||
2026-01-15 01:15:40.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410939&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:15:42.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768410942 status=200 resp_size=5943
|
||
2026-01-15 01:15:42.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410942&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 01:15:44.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768410944 status=200 resp_size=4757
|
||
2026-01-15 01:15:44.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410944&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 01:15:48.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768410948 status=200 resp_size=5591
|
||
2026-01-15 01:15:49.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410948&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:15:50.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768410950 status=200 resp_size=5853
|
||
2026-01-15 01:15:50.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410950&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 01:15:58.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768410957 status=200 resp_size=5360
|
||
2026-01-15 01:15:58.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410958&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 01:16:09.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768410968 status=200 resp_size=5662
|
||
2026-01-15 01:16:09.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410969&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 01:16:09.417 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:16:15.870 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:16:15.870 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 01:16:25.270 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.39 秒后继续...
|
||
2026-01-15 01:16:25.270 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 01:16:25.270 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:16:25.290 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:16:25.866 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:16:27.349 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:16:29.499 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:16:29.499 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:16:30.065 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768410985 status=200 resp_size=131037
|
||
2026-01-15 01:16:30.065 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:16:30.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768410990 status=200 resp_size=5317
|
||
2026-01-15 01:16:30.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410990&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:16:32.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768410991 status=200 resp_size=5651
|
||
2026-01-15 01:16:32.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410992&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 01:16:33.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768410993 status=200 resp_size=4333
|
||
2026-01-15 01:16:34.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768410993&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 01:16:43.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768411002 status=200 resp_size=6269
|
||
2026-01-15 01:16:43.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411003&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 01:16:52.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768411011 status=200 resp_size=5510
|
||
2026-01-15 01:16:52.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411012&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:16:55.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768411015 status=200 resp_size=5151
|
||
2026-01-15 01:16:56.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411015&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:17:05.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768411024 status=200 resp_size=5481
|
||
2026-01-15 01:17:05.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411025&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 01:17:10.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768411030 status=200 resp_size=6454
|
||
2026-01-15 01:17:10.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411030&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:17:19.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768411038 status=200 resp_size=8675
|
||
2026-01-15 01:17:19.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411039&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 01:17:23.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768411043 status=200 resp_size=5938
|
||
2026-01-15 01:17:23.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411043&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 01:17:33.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768411052 status=200 resp_size=8440
|
||
2026-01-15 01:17:33.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411053&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 01:17:41.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768411060 status=200 resp_size=6458
|
||
2026-01-15 01:17:41.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411061&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:17:48.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768411068 status=200 resp_size=5227
|
||
2026-01-15 01:17:49.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411068&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 01:17:58.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768411077 status=200 resp_size=5162
|
||
2026-01-15 01:17:58.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411078&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 01:18:02.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768411082 status=200 resp_size=6408
|
||
2026-01-15 01:18:02.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411082&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 01:18:10.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768411089 status=200 resp_size=6062
|
||
2026-01-15 01:18:10.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411090&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 01:18:16.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768411095 status=200 resp_size=5449
|
||
2026-01-15 01:18:16.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411096&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 01:18:24.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768411103 status=200 resp_size=5712
|
||
2026-01-15 01:18:24.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411104&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 01:18:26.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768411105 status=200 resp_size=6972
|
||
2026-01-15 01:18:26.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411106&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 01:18:27.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768411107 status=200 resp_size=5825
|
||
2026-01-15 01:18:28.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411107&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 01:18:28.175 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:18:34.033 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:18:34.033 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 01:18:43.742 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.71 秒后继续...
|
||
2026-01-15 01:18:43.742 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 01:18:43.742 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:18:43.752 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:18:44.533 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:18:45.717 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:18:47.901 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:18:47.901 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:18:48.364 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411123 status=200 resp_size=107904
|
||
2026-01-15 01:18:48.371 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:18:48.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768411128 status=200 resp_size=5494
|
||
2026-01-15 01:18:48.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411128&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 01:18:50.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768411129 status=200 resp_size=5845
|
||
2026-01-15 01:18:50.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411130&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 01:18:59.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768411137 status=200 resp_size=6139
|
||
2026-01-15 01:18:59.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411139&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 01:19:08.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768411148 status=200 resp_size=5603
|
||
2026-01-15 01:19:08.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411148&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 01:19:15.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768411154 status=200 resp_size=5636
|
||
2026-01-15 01:19:15.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411155&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 01:19:22.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768411161 status=200 resp_size=6222
|
||
2026-01-15 01:19:22.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411162&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 01:19:30.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768411169 status=200 resp_size=7704
|
||
2026-01-15 01:19:30.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411170&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 01:19:40.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768411180 status=200 resp_size=5400
|
||
2026-01-15 01:19:41.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411180&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 01:19:48.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768411188 status=200 resp_size=5846
|
||
2026-01-15 01:19:49.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411188&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 01:19:57.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768411196 status=200 resp_size=4627
|
||
2026-01-15 01:19:57.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411197&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 01:20:00.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768411199 status=200 resp_size=6070
|
||
2026-01-15 01:20:00.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411200&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:20:07.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768411206 status=200 resp_size=6340
|
||
2026-01-15 01:20:07.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411207&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 01:20:11.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768411210 status=200 resp_size=6892
|
||
2026-01-15 01:20:11.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411211&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 01:20:16.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768411216 status=200 resp_size=5290
|
||
2026-01-15 01:20:16.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411216&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 01:20:18.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768411218 status=200 resp_size=5964
|
||
2026-01-15 01:20:18.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411218&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:20:28.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768411228 status=200 resp_size=6423
|
||
2026-01-15 01:20:29.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411228&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 01:20:34.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768411234 status=200 resp_size=6490
|
||
2026-01-15 01:20:34.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411234&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 01:20:42.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768411241 status=200 resp_size=6194
|
||
2026-01-15 01:20:42.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411242&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 01:20:52.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768411252 status=200 resp_size=6066
|
||
2026-01-15 01:20:53.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411252&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:20:56.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768411256 status=200 resp_size=5526
|
||
2026-01-15 01:20:56.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411256&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 01:20:56.633 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:21:02.071 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:21:02.071 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 01:21:06.016 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.93 秒后继续...
|
||
2026-01-15 01:21:06.016 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 01:21:06.016 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:21:06.040 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:21:06.668 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:21:07.815 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:21:09.968 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:21:09.968 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:21:10.361 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411266 status=200 resp_size=106112
|
||
2026-01-15 01:21:10.361 | WARNING | __main__:get_recommend_jobs:745 - 第 20 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:21:10.361 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:21:10.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768411270 status=200 resp_size=6815
|
||
2026-01-15 01:21:10.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411270&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 01:21:11.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768411271 status=200 resp_size=5822
|
||
2026-01-15 01:21:12.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411271&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 01:21:18.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768411277 status=200 resp_size=4786
|
||
2026-01-15 01:21:19.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411278&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 01:21:24.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768411284 status=200 resp_size=6984
|
||
2026-01-15 01:21:25.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411284&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 01:21:32.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768411292 status=200 resp_size=5414
|
||
2026-01-15 01:21:32.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411292&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 01:21:39.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768411299 status=200 resp_size=6066
|
||
2026-01-15 01:21:40.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411299&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 01:21:47.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768411306 status=200 resp_size=5541
|
||
2026-01-15 01:21:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411307&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 01:21:57.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768411316 status=200 resp_size=6058
|
||
2026-01-15 01:21:57.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411317&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 01:22:01.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768411321 status=200 resp_size=5879
|
||
2026-01-15 01:22:01.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411321&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 01:22:08.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768411327 status=200 resp_size=5379
|
||
2026-01-15 01:22:08.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411328&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 01:22:12.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768411332 status=200 resp_size=5651
|
||
2026-01-15 01:22:13.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411332&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 01:22:21.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768411340 status=200 resp_size=6286
|
||
2026-01-15 01:22:21.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411341&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 01:22:30.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768411350 status=200 resp_size=5496
|
||
2026-01-15 01:22:30.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411350&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 01:22:34.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768411354 status=200 resp_size=6106
|
||
2026-01-15 01:22:35.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411354&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 01:22:42.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768411361 status=200 resp_size=6326
|
||
2026-01-15 01:22:42.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411362&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 01:22:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768411366 status=200 resp_size=5398
|
||
2026-01-15 01:22:47.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411366&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 01:22:57.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768411376 status=200 resp_size=5294
|
||
2026-01-15 01:22:57.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411377&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:23:08.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768411387 status=200 resp_size=5984
|
||
2026-01-15 01:23:08.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411388&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 01:23:16.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768411395 status=200 resp_size=5679
|
||
2026-01-15 01:23:16.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411396&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 01:23:16.637 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:23:16.904 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:23:16.904 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 01:23:21.223 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.31 秒后继续...
|
||
2026-01-15 01:23:21.223 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 01:23:21.223 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:23:21.238 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:23:22.258 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:23:23.358 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:23:25.494 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:23:25.494 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:23:25.966 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411401 status=200 resp_size=129203
|
||
2026-01-15 01:23:25.966 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:23:26.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768411405 status=200 resp_size=5833
|
||
2026-01-15 01:23:26.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411406&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 01:23:32.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768411411 status=200 resp_size=6131
|
||
2026-01-15 01:23:32.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411412&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 01:23:43.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768411422 status=200 resp_size=6100
|
||
2026-01-15 01:23:43.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411423&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:23:45.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768411424 status=200 resp_size=5951
|
||
2026-01-15 01:23:45.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411425&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 01:23:49.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768411429 status=200 resp_size=6219
|
||
2026-01-15 01:23:49.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411429&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 01:23:55.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768411435 status=200 resp_size=6031
|
||
2026-01-15 01:23:56.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411435&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 01:23:57.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768411437 status=200 resp_size=5663
|
||
2026-01-15 01:23:57.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411437&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:23:59.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768411439 status=200 resp_size=5849
|
||
2026-01-15 01:23:59.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411439&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 01:24:05.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768411445 status=200 resp_size=6321
|
||
2026-01-15 01:24:06.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411445&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:24:09.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768411449 status=200 resp_size=6351
|
||
2026-01-15 01:24:09.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411449&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 01:24:14.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768411453 status=200 resp_size=5829
|
||
2026-01-15 01:24:14.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411454&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 01:24:17.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768411456 status=200 resp_size=5335
|
||
2026-01-15 01:24:17.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411457&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:24:25.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768411465 status=200 resp_size=6113
|
||
2026-01-15 01:24:26.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411465&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:24:32.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768411471 status=200 resp_size=5095
|
||
2026-01-15 01:24:32.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411472&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 01:24:34.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768411474 status=200 resp_size=5107
|
||
2026-01-15 01:24:35.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411474&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 01:24:39.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768411478 status=200 resp_size=6497
|
||
2026-01-15 01:24:39.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411479&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:24:46.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768411486 status=200 resp_size=6385
|
||
2026-01-15 01:24:46.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411486&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:24:55.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768411495 status=200 resp_size=4774
|
||
2026-01-15 01:24:55.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411495&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 01:24:59.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768411499 status=200 resp_size=5463
|
||
2026-01-15 01:24:59.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411499&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 01:25:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768411500 status=200 resp_size=5473
|
||
2026-01-15 01:25:01.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411500&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:25:01.040 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:25:06.962 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:25:06.962 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 01:25:16.502 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.53 秒后继续...
|
||
2026-01-15 01:25:16.502 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 01:25:16.502 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:25:16.528 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:25:17.110 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:25:18.273 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:25:20.411 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:25:20.411 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:25:20.866 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411516 status=200 resp_size=138940
|
||
2026-01-15 01:25:20.866 | WARNING | __main__:get_recommend_jobs:745 - 第 22 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:25:20.866 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:25:21.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768411520 status=200 resp_size=6963
|
||
2026-01-15 01:25:21.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411521&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:25:23.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768411523 status=200 resp_size=5448
|
||
2026-01-15 01:25:23.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411523&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:25:33.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768411531 status=200 resp_size=6053
|
||
2026-01-15 01:25:33.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411533&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 01:25:37.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768411537 status=200 resp_size=6074
|
||
2026-01-15 01:25:37.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411537&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:25:40.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768411540 status=200 resp_size=7079
|
||
2026-01-15 01:25:40.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411540&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 01:25:50.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768411549 status=200 resp_size=5197
|
||
2026-01-15 01:25:50.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411550&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:25:55.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768411555 status=200 resp_size=7337
|
||
2026-01-15 01:25:55.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411555&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 01:26:00.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768411560 status=200 resp_size=5503
|
||
2026-01-15 01:26:00.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411560&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:26:04.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768411564 status=200 resp_size=6216
|
||
2026-01-15 01:26:05.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411564&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 01:26:13.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768411573 status=200 resp_size=5703
|
||
2026-01-15 01:26:14.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411573&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:26:22.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768411581 status=200 resp_size=5924
|
||
2026-01-15 01:26:22.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411582&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 01:26:26.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768411586 status=200 resp_size=5236
|
||
2026-01-15 01:26:26.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411586&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:26:30.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768411590 status=200 resp_size=6271
|
||
2026-01-15 01:26:30.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411590&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 01:26:40.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768411599 status=200 resp_size=4841
|
||
2026-01-15 01:26:40.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411600&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:26:50.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768411609 status=200 resp_size=6316
|
||
2026-01-15 01:26:50.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411610&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 01:26:58.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768411618 status=200 resp_size=5321
|
||
2026-01-15 01:26:58.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411618&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:27:03.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768411622 status=200 resp_size=5112
|
||
2026-01-15 01:27:03.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411623&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:27:08.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768411628 status=200 resp_size=6150
|
||
2026-01-15 01:27:08.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411628&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 01:27:12.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768411632 status=200 resp_size=5188
|
||
2026-01-15 01:27:12.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411632&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:27:12.976 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:27:18.756 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:27:18.756 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 01:27:28.650 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.89 秒后继续...
|
||
2026-01-15 01:27:28.650 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 01:27:28.650 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:27:28.665 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:27:29.435 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:27:30.612 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:27:32.795 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:27:32.795 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:27:33.266 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411648 status=200 resp_size=133050
|
||
2026-01-15 01:27:33.266 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:27:33.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768411653 status=200 resp_size=5166
|
||
2026-01-15 01:27:33.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411653&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:27:39.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768411659 status=200 resp_size=5373
|
||
2026-01-15 01:27:39.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411659&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:27:42.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768411661 status=200 resp_size=5148
|
||
2026-01-15 01:27:42.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411662&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:27:48.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768411667 status=200 resp_size=4861
|
||
2026-01-15 01:27:48.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411668&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:27:50.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768411669 status=200 resp_size=5055
|
||
2026-01-15 01:27:50.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411670&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:27:52.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768411672 status=200 resp_size=4962
|
||
2026-01-15 01:27:52.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411672&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:27:53.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768411673 status=200 resp_size=4847
|
||
2026-01-15 01:27:53.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411673&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:27:56.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768411676 status=200 resp_size=5409
|
||
2026-01-15 01:27:56.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411676&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:28:05.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768411684 status=200 resp_size=5600
|
||
2026-01-15 01:28:05.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411685&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:28:11.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768411690 status=200 resp_size=5570
|
||
2026-01-15 01:28:11.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411691&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:28:16.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768411696 status=200 resp_size=5032
|
||
2026-01-15 01:28:16.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411696&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:28:23.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768411703 status=200 resp_size=5461
|
||
2026-01-15 01:28:23.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411703&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:28:33.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768411713 status=200 resp_size=5182
|
||
2026-01-15 01:28:33.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411713&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:28:41.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768411721 status=200 resp_size=5200
|
||
2026-01-15 01:28:42.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411721&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:28:52.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768411731 status=200 resp_size=5552
|
||
2026-01-15 01:28:52.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411732&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:29:02.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768411742 status=200 resp_size=5207
|
||
2026-01-15 01:29:03.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411742&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:29:04.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768411744 status=200 resp_size=5489
|
||
2026-01-15 01:29:04.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411744&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:29:06.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768411745 status=200 resp_size=5173
|
||
2026-01-15 01:29:06.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411746&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:29:13.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768411753 status=200 resp_size=5295
|
||
2026-01-15 01:29:13.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411753&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:29:22.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768411761 status=200 resp_size=4383
|
||
2026-01-15 01:29:22.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411762&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 01:29:22.479 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:29:28.556 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:29:28.556 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 01:29:36.547 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.99 秒后继续...
|
||
2026-01-15 01:29:36.547 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 01:29:36.547 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:29:36.566 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:29:37.053 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:29:38.168 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:29:40.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:29:40.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:29:40.774 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411776 status=200 resp_size=125924
|
||
2026-01-15 01:29:40.774 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:29:40.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job×tamp=1768411780 status=200 resp_size=6576
|
||
2026-01-15 01:29:41.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411780&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 01:29:49.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768411789 status=200 resp_size=10670
|
||
2026-01-15 01:29:50.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411789&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 01:29:59.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768411798 status=200 resp_size=4985
|
||
2026-01-15 01:29:59.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411799&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:30:09.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768411809 status=200 resp_size=5236
|
||
2026-01-15 01:30:10.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411809&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 01:30:17.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768411816 status=200 resp_size=4315
|
||
2026-01-15 01:30:17.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411817&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 01:30:27.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768411826 status=200 resp_size=7628
|
||
2026-01-15 01:30:27.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411827&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 01:30:30.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768411830 status=200 resp_size=4972
|
||
2026-01-15 01:30:30.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411830&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:30:33.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768411833 status=200 resp_size=6205
|
||
2026-01-15 01:30:33.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411833&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 01:30:42.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job×tamp=1768411842 status=200 resp_size=4425
|
||
2026-01-15 01:30:42.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411842&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:30:49.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768411849 status=200 resp_size=6095
|
||
2026-01-15 01:30:49.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411849&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:31:00.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768411859 status=200 resp_size=5158
|
||
2026-01-15 01:31:00.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411860&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:31:07.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768411867 status=200 resp_size=5147
|
||
2026-01-15 01:31:07.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411867&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 01:31:14.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768411873 status=200 resp_size=5806
|
||
2026-01-15 01:31:14.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411874&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:31:21.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768411879 status=200 resp_size=6101
|
||
2026-01-15 01:31:21.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411881&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:31:29.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768411888 status=200 resp_size=4978
|
||
2026-01-15 01:31:29.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411889&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:31:35.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768411894 status=200 resp_size=6401
|
||
2026-01-15 01:31:35.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411895&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:31:39.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768411899 status=200 resp_size=4991
|
||
2026-01-15 01:31:39.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411899&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 01:31:42.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768411901 status=200 resp_size=6117
|
||
2026-01-15 01:31:42.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411902&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:31:46.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768411906 status=200 resp_size=5026
|
||
2026-01-15 01:31:46.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411906&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:31:55.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768411914 status=200 resp_size=6793
|
||
2026-01-15 01:31:55.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411915&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:31:55.461 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:32:01.491 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:32:01.491 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 01:32:05.989 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.49 秒后继续...
|
||
2026-01-15 01:32:05.989 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 01:32:05.989 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:32:06.016 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:32:06.739 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:32:07.933 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:32:10.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:32:10.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:32:10.759 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768411926 status=200 resp_size=144015
|
||
2026-01-15 01:32:10.759 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:32:10.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768411930 status=200 resp_size=5111
|
||
2026-01-15 01:32:11.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411930&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:32:20.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768411939 status=200 resp_size=6108
|
||
2026-01-15 01:32:20.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411940&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:32:23.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768411943 status=200 resp_size=4859
|
||
2026-01-15 01:32:23.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411943&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:32:25.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768411945 status=200 resp_size=6546
|
||
2026-01-15 01:32:25.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411945&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 01:32:34.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job×tamp=1768411953 status=200 resp_size=5325
|
||
2026-01-15 01:32:34.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411954&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
|
||
2026-01-15 01:32:36.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768411956 status=200 resp_size=6109
|
||
2026-01-15 01:32:36.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411956&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:32:45.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768411964 status=200 resp_size=5992
|
||
2026-01-15 01:32:45.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411965&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 01:32:52.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768411971 status=200 resp_size=6315
|
||
2026-01-15 01:32:52.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411972&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 01:33:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768411980 status=200 resp_size=7170
|
||
2026-01-15 01:33:01.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411980&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 01:33:02.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768411982 status=200 resp_size=6115
|
||
2026-01-15 01:33:03.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411982&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:33:08.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768411988 status=200 resp_size=4835
|
||
2026-01-15 01:33:08.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411988&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 01:33:17.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768411996 status=200 resp_size=7131
|
||
2026-01-15 01:33:17.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768411997&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 01:33:24.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768412003 status=200 resp_size=6770
|
||
2026-01-15 01:33:24.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412004&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 01:33:32.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768412011 status=200 resp_size=6044
|
||
2026-01-15 01:33:32.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412012&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:33:40.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768412019 status=200 resp_size=5684
|
||
2026-01-15 01:33:41.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412020&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:33:51.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768412030 status=200 resp_size=5215
|
||
2026-01-15 01:33:51.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412031&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 01:34:00.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768412040 status=200 resp_size=6794
|
||
2026-01-15 01:34:01.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412040&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 01:34:02.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768412042 status=200 resp_size=6107
|
||
2026-01-15 01:34:03.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412042&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:34:08.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768412047 status=200 resp_size=6749
|
||
2026-01-15 01:34:08.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412048&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 01:34:18.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768412058 status=200 resp_size=4990
|
||
2026-01-15 01:34:18.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412058&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 01:34:18.993 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:34:19.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:34:19.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 01:34:28.512 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.17 秒后继续...
|
||
2026-01-15 01:34:28.512 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 01:34:28.512 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:34:28.537 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=广安, 工作类型=1318
|
||
2026-01-15 01:34:29.652 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:34:31.332 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:34:33.662 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:34:33.671 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:34:34.195 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412068 status=200 resp_size=115722
|
||
2026-01-15 01:34:34.205 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17) | API返回totalCount: 517 (原始值: 517) | 地区: 广安(广安) | 职能: 专科医生(1318)
|
||
2026-01-15 01:34:34.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768412074 status=200 resp_size=6113
|
||
2026-01-15 01:34:34.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412074&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:34:43.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768412083 status=200 resp_size=6544
|
||
2026-01-15 01:34:44.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412083&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 01:34:46.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768412086 status=200 resp_size=7105
|
||
2026-01-15 01:34:46.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412086&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 01:34:52.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768412091 status=200 resp_size=6107
|
||
2026-01-15 01:34:52.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412092&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:35:01.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768412101 status=200 resp_size=6531
|
||
2026-01-15 01:35:01.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412101&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 01:35:05.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768412105 status=200 resp_size=4704
|
||
2026-01-15 01:35:05.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412105&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 01:35:16.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768412115 status=200 resp_size=6427
|
||
2026-01-15 01:35:16.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412116&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 01:35:24.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768412123 status=200 resp_size=6109
|
||
2026-01-15 01:35:24.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412124&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:35:33.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768412132 status=200 resp_size=5737
|
||
2026-01-15 01:35:33.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412133&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 01:35:44.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768412143 status=200 resp_size=5499
|
||
2026-01-15 01:35:44.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412144&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 01:35:47.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768412147 status=200 resp_size=5880
|
||
2026-01-15 01:35:47.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412147&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 01:35:55.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768412153 status=200 resp_size=6111
|
||
2026-01-15 01:35:55.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412155&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:36:01.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768412161 status=200 resp_size=5139
|
||
2026-01-15 01:36:02.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412161&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:36:06.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768412166 status=200 resp_size=5903
|
||
2026-01-15 01:36:06.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412166&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 01:36:08.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768412168 status=200 resp_size=5129
|
||
2026-01-15 01:36:08.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412168&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 01:36:15.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768412174 status=200 resp_size=6122
|
||
2026-01-15 01:36:15.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412175&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 01:36:18.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768412178 status=200 resp_size=5241
|
||
2026-01-15 01:36:18.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412178&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 01:36:18.534 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
|
||
2026-01-15 01:36:23.624 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 509 条
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 8 条
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 广安(广安)
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 专科医生(1318)
|
||
2026-01-15 01:36:23.624 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.45% (509/517)
|
||
2026-01-15 01:36:23.624 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(509) < API返回总数(517),可能存在分页问题或数据过滤
|
||
2026-01-15 01:36:23.640 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 01:36:23.640 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 01:36:23.640 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 509 条记录)
|
||
2026-01-15 01:36:23.640 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 509 个职位
|
||
2026-01-15 01:36:23.640 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 01:36:31.906 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:36:31.920 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:36:32.263 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 01:36:32.263 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 01:36:32.263 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:36:32.295 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:36:32.860 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:36:33.958 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:36:36.093 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:36:36.093 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:36:36.642 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412192 status=200 resp_size=114197
|
||
2026-01-15 01:36:36.642 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:36:36.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768412196 status=200 resp_size=5670
|
||
2026-01-15 01:36:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412196&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 01:36:40.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768412200 status=200 resp_size=5820
|
||
2026-01-15 01:36:40.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412200&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 01:36:46.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768412206 status=200 resp_size=5184
|
||
2026-01-15 01:36:46.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412206&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 01:36:50.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768412210 status=200 resp_size=5761
|
||
2026-01-15 01:36:50.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412210&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 01:36:59.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768412219 status=200 resp_size=5029
|
||
2026-01-15 01:37:00.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412219&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 01:37:03.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768412223 status=200 resp_size=5579
|
||
2026-01-15 01:37:04.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412223&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 01:37:11.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768412230 status=200 resp_size=5000
|
||
2026-01-15 01:37:11.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412231&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 01:37:17.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768412236 status=200 resp_size=5546
|
||
2026-01-15 01:37:17.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412237&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 01:37:26.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768412245 status=200 resp_size=4913
|
||
2026-01-15 01:37:26.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412246&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 01:37:34.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768412254 status=200 resp_size=5630
|
||
2026-01-15 01:37:34.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412254&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 01:37:43.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768412262 status=200 resp_size=6579
|
||
2026-01-15 01:37:43.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412263&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 01:37:52.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768412272 status=200 resp_size=5739
|
||
2026-01-15 01:37:52.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412272&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 01:38:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768412280 status=200 resp_size=4954
|
||
2026-01-15 01:38:01.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412280&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 01:38:09.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768412288 status=200 resp_size=6192
|
||
2026-01-15 01:38:09.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412289&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 01:38:10.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768412290 status=200 resp_size=5890
|
||
2026-01-15 01:38:11.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412290&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:38:17.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768412297 status=200 resp_size=4892
|
||
2026-01-15 01:38:17.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412297&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 01:38:21.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768412301 status=200 resp_size=5976
|
||
2026-01-15 01:38:21.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412301&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 01:38:24.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768412304 status=200 resp_size=5431
|
||
2026-01-15 01:38:24.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412304&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 01:38:34.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768412313 status=200 resp_size=6023
|
||
2026-01-15 01:38:34.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412314&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:38:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768412316 status=200 resp_size=6048
|
||
2026-01-15 01:38:37.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412316&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:38:37.191 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:38:37.475 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:38:37.475 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 01:38:37.475 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 01:38:43.692 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.20 秒后继续...
|
||
2026-01-15 01:38:43.692 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 01:38:43.692 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:38:43.711 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:38:44.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:38:45.391 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:38:47.536 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:38:47.542 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:38:47.982 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412323 status=200 resp_size=112524
|
||
2026-01-15 01:38:47.997 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:38:48.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768412327 status=200 resp_size=6399
|
||
2026-01-15 01:38:48.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412328&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:38:50.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768412330 status=200 resp_size=6192
|
||
2026-01-15 01:38:50.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412330&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 01:39:01.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768412340 status=200 resp_size=5721
|
||
2026-01-15 01:39:01.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412341&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 01:39:11.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768412350 status=200 resp_size=5634
|
||
2026-01-15 01:39:11.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412351&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 01:39:20.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768412359 status=200 resp_size=6015
|
||
2026-01-15 01:39:20.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412360&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-15 01:39:26.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768412365 status=200 resp_size=6787
|
||
2026-01-15 01:39:26.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412366&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 01:39:34.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768412373 status=200 resp_size=5480
|
||
2026-01-15 01:39:34.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412374&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 01:39:36.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768412376 status=200 resp_size=5189
|
||
2026-01-15 01:39:37.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412376&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 01:39:40.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768412380 status=200 resp_size=6137
|
||
2026-01-15 01:39:40.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412380&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 01:39:50.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768412389 status=200 resp_size=6134
|
||
2026-01-15 01:39:50.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412390&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 01:39:59.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768412399 status=200 resp_size=5591
|
||
2026-01-15 01:39:59.785 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412399&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 01:40:06.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768412406 status=200 resp_size=5110
|
||
2026-01-15 01:40:07.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412406&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 01:40:10.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768412410 status=200 resp_size=5974
|
||
2026-01-15 01:40:11.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412410&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:40:13.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768412413 status=200 resp_size=5940
|
||
2026-01-15 01:40:13.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412413&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 01:40:18.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768412418 status=200 resp_size=5601
|
||
2026-01-15 01:40:18.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412418&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:40:21.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768412421 status=200 resp_size=5374
|
||
2026-01-15 01:40:21.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412421&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:40:26.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768412426 status=200 resp_size=6179
|
||
2026-01-15 01:40:26.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412426&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 01:40:33.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768412432 status=200 resp_size=5478
|
||
2026-01-15 01:40:33.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412433&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 01:40:36.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768412436 status=200 resp_size=5610
|
||
2026-01-15 01:40:37.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412436&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 01:40:46.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768412445 status=200 resp_size=5682
|
||
2026-01-15 01:40:46.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412446&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:40:46.452 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:40:52.702 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:40:52.702 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 01:41:01.489 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.78 秒后继续...
|
||
2026-01-15 01:41:01.489 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 01:41:01.489 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:41:01.513 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:41:02.095 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:41:03.225 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:41:05.878 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:41:05.878 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:41:06.271 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412461 status=200 resp_size=110443
|
||
2026-01-15 01:41:06.271 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:41:06.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768412466 status=200 resp_size=5524
|
||
2026-01-15 01:41:06.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412466&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 01:41:12.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768412472 status=200 resp_size=5502
|
||
2026-01-15 01:41:12.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412472&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 01:41:16.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768412476 status=200 resp_size=6076
|
||
2026-01-15 01:41:16.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412476&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 01:41:19.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768412479 status=200 resp_size=5653
|
||
2026-01-15 01:41:19.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412479&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 01:41:29.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768412488 status=200 resp_size=5677
|
||
2026-01-15 01:41:29.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412489&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 01:41:34.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768412494 status=200 resp_size=5513
|
||
2026-01-15 01:41:34.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412494&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 01:41:41.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768412500 status=200 resp_size=6285
|
||
2026-01-15 01:41:41.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412501&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 01:41:45.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768412505 status=200 resp_size=5127
|
||
2026-01-15 01:41:46.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412505&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 01:41:49.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768412509 status=200 resp_size=5845
|
||
2026-01-15 01:41:49.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412509&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:41:58.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768412517 status=200 resp_size=5182
|
||
2026-01-15 01:41:58.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412518&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 01:42:05.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768412524 status=200 resp_size=5968
|
||
2026-01-15 01:42:05.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412525&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 01:42:14.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768412533 status=200 resp_size=5321
|
||
2026-01-15 01:42:14.630 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412534&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:42:24.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768412544 status=200 resp_size=6318
|
||
2026-01-15 01:42:24.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412544&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 01:42:34.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768412553 status=200 resp_size=5732
|
||
2026-01-15 01:42:34.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412554&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 01:42:36.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768412556 status=200 resp_size=5729
|
||
2026-01-15 01:42:36.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412556&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:42:40.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768412560 status=200 resp_size=5222
|
||
2026-01-15 01:42:40.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412560&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 01:42:43.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768412562 status=200 resp_size=5613
|
||
2026-01-15 01:42:43.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412563&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 01:42:46.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768412566 status=200 resp_size=5711
|
||
2026-01-15 01:42:46.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412566&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 01:42:53.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768412572 status=200 resp_size=6024
|
||
2026-01-15 01:42:53.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412573&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 01:43:01.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768412580 status=200 resp_size=5245
|
||
2026-01-15 01:43:01.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412581&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 01:43:01.432 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:43:01.761 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:43:01.761 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 01:43:06.539 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.77 秒后继续...
|
||
2026-01-15 01:43:06.539 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 01:43:06.539 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:43:06.567 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:43:07.012 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:43:08.107 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:43:10.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:43:10.196 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:43:10.604 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412586 status=200 resp_size=119936
|
||
2026-01-15 01:43:10.604 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:43:10.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768412590 status=200 resp_size=7499
|
||
2026-01-15 01:43:10.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412590&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 01:43:20.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768412599 status=200 resp_size=6139
|
||
2026-01-15 01:43:20.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412600&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 01:43:28.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768412607 status=200 resp_size=6651
|
||
2026-01-15 01:43:28.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412608&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 01:43:37.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768412617 status=200 resp_size=5825
|
||
2026-01-15 01:43:38.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412617&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:43:45.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768412624 status=200 resp_size=6511
|
||
2026-01-15 01:43:45.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412625&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:43:51.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768412631 status=200 resp_size=6448
|
||
2026-01-15 01:43:51.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412631&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 01:44:01.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768412641 status=200 resp_size=6466
|
||
2026-01-15 01:44:02.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412641&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:44:03.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768412643 status=200 resp_size=5785
|
||
2026-01-15 01:44:03.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412643&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:44:10.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768412649 status=200 resp_size=6422
|
||
2026-01-15 01:44:10.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412650&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 01:44:15.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768412655 status=200 resp_size=5803
|
||
2026-01-15 01:44:15.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412655&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:44:22.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768412661 status=200 resp_size=5961
|
||
2026-01-15 01:44:22.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412662&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:44:29.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768412668 status=200 resp_size=6392
|
||
2026-01-15 01:44:29.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412669&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 01:44:31.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768412671 status=200 resp_size=8364
|
||
2026-01-15 01:44:31.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412671&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-15 01:44:42.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768412681 status=200 resp_size=6045
|
||
2026-01-15 01:44:42.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412682&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:44:49.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768412688 status=200 resp_size=6511
|
||
2026-01-15 01:44:49.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412689&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 01:44:51.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768412691 status=200 resp_size=5936
|
||
2026-01-15 01:44:52.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412691&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:44:56.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768412696 status=200 resp_size=5876
|
||
2026-01-15 01:44:56.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412696&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 01:44:59.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768412699 status=200 resp_size=4058
|
||
2026-01-15 01:45:00.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412699&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 01:45:02.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768412702 status=200 resp_size=5228
|
||
2026-01-15 01:45:03.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412702&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:45:05.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768412705 status=200 resp_size=6177
|
||
2026-01-15 01:45:06.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412705&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 01:45:06.084 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:45:06.460 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:45:06.460 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 01:45:12.748 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.29 秒后继续...
|
||
2026-01-15 01:45:12.748 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 01:45:12.748 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:45:12.775 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:45:13.292 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:45:14.549 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:45:16.699 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:45:16.699 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:45:17.186 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412712 status=200 resp_size=139609
|
||
2026-01-15 01:45:17.186 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:45:17.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768412717 status=200 resp_size=5756
|
||
2026-01-15 01:45:17.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412717&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:45:23.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768412723 status=200 resp_size=5634
|
||
2026-01-15 01:45:23.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412723&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:45:25.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768412725 status=200 resp_size=6125
|
||
2026-01-15 01:45:25.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412725&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:45:30.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768412729 status=200 resp_size=5888
|
||
2026-01-15 01:45:30.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412730&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 01:45:33.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768412733 status=200 resp_size=6856
|
||
2026-01-15 01:45:33.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412733&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 01:45:40.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768412739 status=200 resp_size=6055
|
||
2026-01-15 01:45:40.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412740&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 01:45:45.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768412745 status=200 resp_size=5455
|
||
2026-01-15 01:45:45.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412745&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 01:45:51.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768412750 status=200 resp_size=7534
|
||
2026-01-15 01:45:51.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412751&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 01:45:55.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768412754 status=200 resp_size=6718
|
||
2026-01-15 01:45:55.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412755&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 01:45:58.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768412758 status=200 resp_size=6314
|
||
2026-01-15 01:45:58.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412758&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 01:46:04.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768412764 status=200 resp_size=6573
|
||
2026-01-15 01:46:04.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412764&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 01:46:14.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768412773 status=200 resp_size=6058
|
||
2026-01-15 01:46:14.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412774&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:46:23.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768412783 status=200 resp_size=6715
|
||
2026-01-15 01:46:23.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412783&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 01:46:25.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768412785 status=200 resp_size=5699
|
||
2026-01-15 01:46:25.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412785&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 01:46:33.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768412792 status=200 resp_size=5845
|
||
2026-01-15 01:46:33.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412793&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 01:46:42.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768412802 status=200 resp_size=6473
|
||
2026-01-15 01:46:42.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412802&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:46:45.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768412805 status=200 resp_size=5211
|
||
2026-01-15 01:46:45.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412805&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 01:46:54.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768412813 status=200 resp_size=5942
|
||
2026-01-15 01:46:54.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412814&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 01:46:59.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768412819 status=200 resp_size=8574
|
||
2026-01-15 01:46:59.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412819&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 01:47:02.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768412822 status=200 resp_size=6024
|
||
2026-01-15 01:47:02.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412822&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:47:02.769 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:47:09.161 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:47:09.161 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 01:47:18.329 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.16 秒后继续...
|
||
2026-01-15 01:47:18.329 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 01:47:18.329 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:47:18.351 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:47:18.916 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:47:20.064 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:47:22.183 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:47:22.183 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:47:22.638 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412838 status=200 resp_size=139904
|
||
2026-01-15 01:47:22.638 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:47:22.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768412842 status=200 resp_size=6366
|
||
2026-01-15 01:47:22.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412842&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-15 01:47:26.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768412846 status=200 resp_size=6419
|
||
2026-01-15 01:47:26.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412846&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:47:27.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768412847 status=200 resp_size=7551
|
||
2026-01-15 01:47:27.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412847&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 01:47:36.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768412856 status=200 resp_size=5421
|
||
2026-01-15 01:47:36.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412856&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:47:38.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768412858 status=200 resp_size=5784
|
||
2026-01-15 01:47:39.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412858&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 01:47:47.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768412867 status=200 resp_size=5306
|
||
2026-01-15 01:47:48.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412867&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 01:47:50.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768412870 status=200 resp_size=7182
|
||
2026-01-15 01:47:50.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412870&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 01:47:59.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768412878 status=200 resp_size=5687
|
||
2026-01-15 01:47:59.554 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412879&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:48:09.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768412888 status=200 resp_size=5407
|
||
2026-01-15 01:48:09.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412889&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 01:48:14.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768412893 status=200 resp_size=7285
|
||
2026-01-15 01:48:14.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412894&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 01:48:20.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768412899 status=200 resp_size=6343
|
||
2026-01-15 01:48:20.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412900&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 01:48:29.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768412909 status=200 resp_size=6958
|
||
2026-01-15 01:48:30.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412909&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:48:31.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768412911 status=200 resp_size=8231
|
||
2026-01-15 01:48:32.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412911&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 01:48:40.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768412920 status=200 resp_size=7119
|
||
2026-01-15 01:48:40.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412920&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 01:48:45.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768412924 status=200 resp_size=5615
|
||
2026-01-15 01:48:45.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412925&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 01:48:54.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768412933 status=200 resp_size=6552
|
||
2026-01-15 01:48:54.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412934&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:49:00.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768412939 status=200 resp_size=6714
|
||
2026-01-15 01:49:00.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412940&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 01:49:04.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768412943 status=200 resp_size=5775
|
||
2026-01-15 01:49:04.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412944&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 01:49:11.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768412950 status=200 resp_size=6684
|
||
2026-01-15 01:49:11.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412951&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 01:49:13.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768412953 status=200 resp_size=5497
|
||
2026-01-15 01:49:13.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412953&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:49:13.619 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:49:19.949 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:49:19.949 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 01:49:23.871 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.92 秒后继续...
|
||
2026-01-15 01:49:23.871 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 01:49:23.871 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:49:23.891 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:49:24.330 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:49:25.444 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:49:27.564 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:49:27.564 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:49:28.035 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768412963 status=200 resp_size=138138
|
||
2026-01-15 01:49:28.035 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:49:28.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768412968 status=200 resp_size=13102
|
||
2026-01-15 01:49:28.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412968&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 01:49:37.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768412976 status=200 resp_size=5128
|
||
2026-01-15 01:49:37.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412977&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 01:49:41.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768412981 status=200 resp_size=6362
|
||
2026-01-15 01:49:41.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412981&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 01:49:47.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768412987 status=200 resp_size=6689
|
||
2026-01-15 01:49:47.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412987&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:49:53.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768412993 status=200 resp_size=6527
|
||
2026-01-15 01:49:53.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768412993&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 01:50:03.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768413002 status=200 resp_size=7130
|
||
2026-01-15 01:50:03.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413003&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 01:50:05.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768413004 status=200 resp_size=7415
|
||
2026-01-15 01:50:05.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413005&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 01:50:12.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768413011 status=200 resp_size=6390
|
||
2026-01-15 01:50:12.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413012&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:50:20.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768413019 status=200 resp_size=5152
|
||
2026-01-15 01:50:20.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413020&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 01:50:25.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768413025 status=200 resp_size=5877
|
||
2026-01-15 01:50:25.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413025&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 01:50:32.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768413031 status=200 resp_size=6041
|
||
2026-01-15 01:50:32.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413032&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 01:50:38.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768413037 status=200 resp_size=6254
|
||
2026-01-15 01:50:38.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413038&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:50:41.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768413041 status=200 resp_size=5098
|
||
2026-01-15 01:50:42.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413041&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 01:50:52.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768413051 status=200 resp_size=5711
|
||
2026-01-15 01:50:52.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413052&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 01:51:03.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768413062 status=200 resp_size=6970
|
||
2026-01-15 01:51:03.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413063&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 01:51:10.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768413069 status=200 resp_size=7120
|
||
2026-01-15 01:51:10.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413070&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:51:14.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768413074 status=200 resp_size=5109
|
||
2026-01-15 01:51:14.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413074&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 01:51:20.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768413080 status=200 resp_size=7717
|
||
2026-01-15 01:51:20.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413080&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 01:51:23.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768413083 status=200 resp_size=8734
|
||
2026-01-15 01:51:23.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413083&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 01:51:24.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768413084 status=200 resp_size=6230
|
||
2026-01-15 01:51:25.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413084&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:51:25.104 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 01:51:31.389 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 01:51:31.389 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 01:51:37.313 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.92 秒后继续...
|
||
2026-01-15 01:51:37.313 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 01:51:37.313 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:51:37.340 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:51:38.031 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:51:39.195 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:51:41.360 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:51:41.360 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:51:41.848 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413097 status=200 resp_size=137357
|
||
2026-01-15 01:51:41.848 | WARNING | __main__:get_recommend_jobs:745 - 第 8 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:51:41.848 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:51:42.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768413101 status=200 resp_size=4321
|
||
2026-01-15 01:51:42.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413102&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 01:51:50.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768413110 status=200 resp_size=5531
|
||
2026-01-15 01:51:51.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413110&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 01:52:00.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768413120 status=200 resp_size=5920
|
||
2026-01-15 01:52:00.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413120&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:52:03.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768413122 status=200 resp_size=6522
|
||
2026-01-15 01:52:03.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413123&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 01:52:05.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768413125 status=200 resp_size=7756
|
||
2026-01-15 01:52:05.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413125&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 01:52:12.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768413131 status=200 resp_size=7299
|
||
2026-01-15 01:52:12.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413132&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 01:52:19.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768413138 status=200 resp_size=6445
|
||
2026-01-15 01:52:19.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413139&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:52:26.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768413145 status=200 resp_size=5458
|
||
2026-01-15 01:52:26.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413146&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 01:52:28.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768413148 status=200 resp_size=7237
|
||
2026-01-15 01:52:28.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413148&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 01:52:36.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768413155 status=200 resp_size=4995
|
||
2026-01-15 01:52:36.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413156&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:52:37.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768413157 status=200 resp_size=5342
|
||
2026-01-15 01:52:37.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413157&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 01:52:44.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768413163 status=200 resp_size=6431
|
||
2026-01-15 01:52:44.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413164&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 01:52:47.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768413167 status=200 resp_size=7607
|
||
2026-01-15 01:52:48.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413167&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 01:52:54.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768413173 status=200 resp_size=6501
|
||
2026-01-15 01:52:54.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413174&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:53:02.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768413181 status=200 resp_size=6416
|
||
2026-01-15 01:53:02.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413182&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 01:53:07.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768413186 status=200 resp_size=5678
|
||
2026-01-15 01:53:07.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413187&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:53:10.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768413190 status=200 resp_size=6646
|
||
2026-01-15 01:53:10.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413190&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 01:53:13.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768413193 status=200 resp_size=5477
|
||
2026-01-15 01:53:13.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413193&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 01:53:23.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768413202 status=200 resp_size=6449
|
||
2026-01-15 01:53:23.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413203&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 01:53:23.325 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:53:29.434 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:53:29.434 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 01:53:34.647 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.20 秒后继续...
|
||
2026-01-15 01:53:34.647 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 01:53:34.648 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:53:34.664 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:53:35.308 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:53:36.471 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:53:38.623 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:53:38.623 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:53:39.161 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413214 status=200 resp_size=165078
|
||
2026-01-15 01:53:39.161 | WARNING | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:53:39.161 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:53:39.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768413219 status=200 resp_size=8457
|
||
2026-01-15 01:53:39.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413219&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:53:41.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768413221 status=200 resp_size=5925
|
||
2026-01-15 01:53:42.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413221&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 01:53:48.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768413227 status=200 resp_size=7750
|
||
2026-01-15 01:53:48.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413228&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 01:53:57.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768413237 status=200 resp_size=7971
|
||
2026-01-15 01:53:58.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413237&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 01:54:07.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768413246 status=200 resp_size=6764
|
||
2026-01-15 01:54:07.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413247&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:54:09.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768413249 status=200 resp_size=8313
|
||
2026-01-15 01:54:09.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413249&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 01:54:16.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768413256 status=200 resp_size=5424
|
||
2026-01-15 01:54:16.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413256&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 01:54:24.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768413264 status=200 resp_size=8301
|
||
2026-01-15 01:54:25.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413264&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 01:54:33.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768413272 status=200 resp_size=6168
|
||
2026-01-15 01:54:33.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413273&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:54:40.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768413279 status=200 resp_size=8701
|
||
2026-01-15 01:54:40.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413280&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 01:54:43.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768413283 status=200 resp_size=5378
|
||
2026-01-15 01:54:43.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413283&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 01:54:50.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768413289 status=200 resp_size=7262
|
||
2026-01-15 01:54:50.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413290&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 01:54:56.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768413295 status=200 resp_size=7967
|
||
2026-01-15 01:54:56.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413296&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 01:55:07.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768413306 status=200 resp_size=5253
|
||
2026-01-15 01:55:07.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413307&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 01:55:17.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768413316 status=200 resp_size=5431
|
||
2026-01-15 01:55:17.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413317&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 01:55:19.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768413319 status=200 resp_size=6119
|
||
2026-01-15 01:55:20.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413319&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:55:23.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768413322 status=200 resp_size=6080
|
||
2026-01-15 01:55:23.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413323&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 01:55:28.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768413328 status=200 resp_size=5916
|
||
2026-01-15 01:55:28.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413328&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 01:55:33.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768413333 status=200 resp_size=4916
|
||
2026-01-15 01:55:33.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413333&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 01:55:33.684 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:55:40.092 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:55:40.092 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 01:55:47.529 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.42 秒后继续...
|
||
2026-01-15 01:55:47.529 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 01:55:47.529 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:55:47.551 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:55:48.101 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:55:49.218 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:55:51.355 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:55:51.355 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:55:51.826 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413347 status=200 resp_size=134843
|
||
2026-01-15 01:55:51.826 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位(已跳过)
|
||
2026-01-15 01:55:51.826 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 18) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:55:51.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768413351 status=200 resp_size=6053
|
||
2026-01-15 01:55:52.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413351&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 01:55:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768413358 status=200 resp_size=6494
|
||
2026-01-15 01:55:59.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413359&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 01:56:02.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768413362 status=200 resp_size=6226
|
||
2026-01-15 01:56:02.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413362&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 01:56:04.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768413364 status=200 resp_size=6284
|
||
2026-01-15 01:56:04.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413364&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:56:08.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768413368 status=200 resp_size=6176
|
||
2026-01-15 01:56:08.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413368&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 01:56:18.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768413378 status=200 resp_size=5673
|
||
2026-01-15 01:56:19.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413378&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 01:56:25.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768413385 status=200 resp_size=6731
|
||
2026-01-15 01:56:25.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413385&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 01:56:27.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768413387 status=200 resp_size=5856
|
||
2026-01-15 01:56:27.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413387&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:56:34.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768413393 status=200 resp_size=5575
|
||
2026-01-15 01:56:34.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413394&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 01:56:44.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768413403 status=200 resp_size=5731
|
||
2026-01-15 01:56:44.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413404&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 01:56:54.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768413413 status=200 resp_size=7075
|
||
2026-01-15 01:56:54.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413414&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 01:57:01.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768413420 status=200 resp_size=5792
|
||
2026-01-15 01:57:01.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413421&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:57:11.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768413430 status=200 resp_size=6526
|
||
2026-01-15 01:57:11.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413431&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:57:21.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768413440 status=200 resp_size=8973
|
||
2026-01-15 01:57:21.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413441&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 01:57:28.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768413448 status=200 resp_size=8559
|
||
2026-01-15 01:57:29.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413448&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 01:57:30.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768413450 status=200 resp_size=6688
|
||
2026-01-15 01:57:30.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413450&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 01:57:37.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768413457 status=200 resp_size=5290
|
||
2026-01-15 01:57:38.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413457&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 01:57:44.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768413464 status=200 resp_size=5982
|
||
2026-01-15 01:57:45.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413464&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 01:57:45.024 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 18
|
||
2026-01-15 01:57:50.695 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
|
||
2026-01-15 01:57:50.695 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 01:57:54.180 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.47 秒后继续...
|
||
2026-01-15 01:57:54.180 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 01:57:54.180 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:57:54.193 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:57:54.696 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:57:55.796 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:57:57.916 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:57:57.916 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:57:58.371 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413474 status=200 resp_size=139155
|
||
2026-01-15 01:57:58.371 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 01:57:58.371 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:57:58.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768413478 status=200 resp_size=7919
|
||
2026-01-15 01:57:58.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413478&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 01:58:02.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768413482 status=200 resp_size=7681
|
||
2026-01-15 01:58:02.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413482&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 01:58:08.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768413488 status=200 resp_size=5259
|
||
2026-01-15 01:58:09.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413488&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 01:58:10.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768413490 status=200 resp_size=5414
|
||
2026-01-15 01:58:10.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413490&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 01:58:16.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768413495 status=200 resp_size=6660
|
||
2026-01-15 01:58:16.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413496&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 01:58:26.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768413506 status=200 resp_size=7952
|
||
2026-01-15 01:58:26.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413506&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 01:58:30.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768413509 status=200 resp_size=6635
|
||
2026-01-15 01:58:30.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413510&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 01:58:40.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768413520 status=200 resp_size=5277
|
||
2026-01-15 01:58:40.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413520&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 01:58:50.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768413529 status=200 resp_size=7175
|
||
2026-01-15 01:58:50.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413530&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 01:58:56.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768413535 status=200 resp_size=6280
|
||
2026-01-15 01:58:56.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413536&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:59:04.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768413544 status=200 resp_size=5924
|
||
2026-01-15 01:59:05.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413544&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 01:59:12.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768413551 status=200 resp_size=6003
|
||
2026-01-15 01:59:12.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413552&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 01:59:13.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768413553 status=200 resp_size=5672
|
||
2026-01-15 01:59:13.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413553&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 01:59:17.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768413557 status=200 resp_size=5378
|
||
2026-01-15 01:59:17.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413557&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 01:59:21.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768413560 status=200 resp_size=5084
|
||
2026-01-15 01:59:21.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413561&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 01:59:24.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768413564 status=200 resp_size=9486
|
||
2026-01-15 01:59:24.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413564&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 01:59:32.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768413571 status=200 resp_size=5363
|
||
2026-01-15 01:59:32.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413572&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 01:59:38.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768413577 status=200 resp_size=13285
|
||
2026-01-15 01:59:38.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413578&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 01:59:44.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768413583 status=200 resp_size=6869
|
||
2026-01-15 01:59:44.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413584&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 01:59:44.427 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 01:59:50.349 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 01:59:50.349 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 01:59:54.956 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.60 秒后继续...
|
||
2026-01-15 01:59:54.956 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 01:59:54.956 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 01:59:54.982 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 01:59:55.579 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:59:56.706 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:59:58.815 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 01:59:58.815 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 01:59:59.255 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413594 status=200 resp_size=125658
|
||
2026-01-15 01:59:59.255 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 01:59:59.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768413599 status=200 resp_size=6041
|
||
2026-01-15 01:59:59.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413599&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 02:00:10.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768413609 status=200 resp_size=5390
|
||
2026-01-15 02:00:10.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413610&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 02:00:14.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768413614 status=200 resp_size=8070
|
||
2026-01-15 02:00:14.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413614&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 02:00:23.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768413622 status=200 resp_size=6588
|
||
2026-01-15 02:00:23.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413623&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 02:00:30.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768413629 status=200 resp_size=6300
|
||
2026-01-15 02:00:30.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413630&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 02:00:32.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768413632 status=200 resp_size=6069
|
||
2026-01-15 02:00:33.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413632&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:00:42.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768413642 status=200 resp_size=7194
|
||
2026-01-15 02:00:42.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413642&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 02:00:46.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768413646 status=200 resp_size=7170
|
||
2026-01-15 02:00:46.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413646&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:00:56.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768413655 status=200 resp_size=4572
|
||
2026-01-15 02:00:56.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413656&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 02:01:05.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768413665 status=200 resp_size=4992
|
||
2026-01-15 02:01:06.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413665&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 02:01:12.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768413672 status=200 resp_size=7194
|
||
2026-01-15 02:01:13.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413672&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 02:01:21.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768413680 status=200 resp_size=5332
|
||
2026-01-15 02:01:21.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413681&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 02:01:23.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768413682 status=200 resp_size=5554
|
||
2026-01-15 02:01:23.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413683&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:01:33.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768413692 status=200 resp_size=5280
|
||
2026-01-15 02:01:33.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413693&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 02:01:40.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768413699 status=200 resp_size=5040
|
||
2026-01-15 02:01:40.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413700&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 02:01:44.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768413704 status=200 resp_size=4993
|
||
2026-01-15 02:01:44.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413704&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:01:45.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768413705 status=200 resp_size=6748
|
||
2026-01-15 02:01:45.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413705&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:01:55.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768413714 status=200 resp_size=5883
|
||
2026-01-15 02:01:55.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413715&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 02:01:57.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768413717 status=200 resp_size=5764
|
||
2026-01-15 02:01:57.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413717&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:02:05.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768413724 status=200 resp_size=6980
|
||
2026-01-15 02:02:05.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413725&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 02:02:05.282 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:02:11.076 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:02:11.076 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 02:02:17.297 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.22 秒后继续...
|
||
2026-01-15 02:02:17.297 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 02:02:17.297 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:02:17.312 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:02:17.925 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:02:19.056 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:02:21.179 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:02:21.179 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:02:21.729 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413737 status=200 resp_size=148282
|
||
2026-01-15 02:02:21.729 | WARNING | __main__:get_recommend_jobs:745 - 第 13 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 02:02:21.729 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:02:21.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768413741 status=200 resp_size=5283
|
||
2026-01-15 02:02:22.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413741&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:02:25.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768413744 status=200 resp_size=5501
|
||
2026-01-15 02:02:25.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413745&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 02:02:35.251 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768413754 status=200 resp_size=6659
|
||
2026-01-15 02:02:35.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413755&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:02:38.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768413758 status=200 resp_size=5165
|
||
2026-01-15 02:02:38.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413758&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 02:02:40.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768413760 status=200 resp_size=5570
|
||
2026-01-15 02:02:41.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413760&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 02:02:42.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768413762 status=200 resp_size=9108
|
||
2026-01-15 02:02:42.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413762&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 02:02:47.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768413766 status=200 resp_size=5688
|
||
2026-01-15 02:02:47.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413767&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 02:02:50.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768413770 status=200 resp_size=6380
|
||
2026-01-15 02:02:50.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413770&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 02:02:57.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768413776 status=200 resp_size=6621
|
||
2026-01-15 02:02:57.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413777&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 02:03:01.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768413780 status=200 resp_size=7975
|
||
2026-01-15 02:03:01.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413781&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 02:03:06.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768413785 status=200 resp_size=5984
|
||
2026-01-15 02:03:06.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413786&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 02:03:13.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768413793 status=200 resp_size=5582
|
||
2026-01-15 02:03:14.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413793&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 02:03:20.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768413799 status=200 resp_size=6939
|
||
2026-01-15 02:03:20.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413800&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 02:03:24.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768413804 status=200 resp_size=5924
|
||
2026-01-15 02:03:24.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413804&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 02:03:30.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768413810 status=200 resp_size=6027
|
||
2026-01-15 02:03:31.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413810&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 02:03:33.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768413813 status=200 resp_size=6028
|
||
2026-01-15 02:03:33.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413813&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:03:35.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768413815 status=200 resp_size=6111
|
||
2026-01-15 02:03:35.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413815&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 02:03:37.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768413817 status=200 resp_size=8782
|
||
2026-01-15 02:03:37.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413817&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 02:03:45.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768413825 status=200 resp_size=8655
|
||
2026-01-15 02:03:46.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413825&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 02:03:46.061 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 02:03:51.796 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 02:03:51.796 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 02:03:54.815 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.01 秒后继续...
|
||
2026-01-15 02:03:54.815 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 02:03:54.815 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:03:54.843 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:03:55.455 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:03:56.602 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:03:58.769 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:03:58.769 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:03:59.240 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413834 status=200 resp_size=143984
|
||
2026-01-15 02:03:59.240 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:03:59.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768413839 status=200 resp_size=6440
|
||
2026-01-15 02:03:59.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413839&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 02:04:06.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768413845 status=200 resp_size=7907
|
||
2026-01-15 02:04:06.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413846&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 02:04:12.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768413852 status=200 resp_size=4592
|
||
2026-01-15 02:04:13.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413852&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 02:04:21.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768413861 status=200 resp_size=5878
|
||
2026-01-15 02:04:21.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413861&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:04:26.349 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768413866 status=200 resp_size=6437
|
||
2026-01-15 02:04:26.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413866&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 02:04:37.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768413876 status=200 resp_size=7313
|
||
2026-01-15 02:04:37.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413877&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 02:04:44.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768413884 status=200 resp_size=6958
|
||
2026-01-15 02:04:45.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413884&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 02:04:46.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768413886 status=200 resp_size=6694
|
||
2026-01-15 02:04:46.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413886&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 02:04:55.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768413895 status=200 resp_size=6568
|
||
2026-01-15 02:04:56.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413895&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 02:05:04.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768413903 status=200 resp_size=5922
|
||
2026-01-15 02:05:04.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413904&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 02:05:13.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768413913 status=200 resp_size=5499
|
||
2026-01-15 02:05:14.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413913&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 02:05:22.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768413922 status=200 resp_size=6184
|
||
2026-01-15 02:05:23.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413922&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 02:05:24.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768413924 status=200 resp_size=5673
|
||
2026-01-15 02:05:24.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413924&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 02:05:30.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768413929 status=200 resp_size=7081
|
||
2026-01-15 02:05:30.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413930&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 02:05:37.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768413936 status=200 resp_size=7664
|
||
2026-01-15 02:05:37.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413937&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 02:05:45.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768413944 status=200 resp_size=6652
|
||
2026-01-15 02:05:45.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413945&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 02:05:49.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768413949 status=200 resp_size=4733
|
||
2026-01-15 02:05:49.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413949&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:05:59.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768413958 status=200 resp_size=4926
|
||
2026-01-15 02:05:59.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413959&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 02:06:06.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768413965 status=200 resp_size=4906
|
||
2026-01-15 02:06:06.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413966&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 02:06:12.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768413972 status=200 resp_size=7369
|
||
2026-01-15 02:06:12.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413972&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 02:06:12.622 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:06:18.698 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:06:18.698 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 02:06:25.374 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.67 秒后继续...
|
||
2026-01-15 02:06:25.374 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 02:06:25.374 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:06:25.403 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:06:26.063 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:06:27.224 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:06:29.376 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:06:29.376 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:06:29.879 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768413985 status=200 resp_size=136405
|
||
2026-01-15 02:06:29.879 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:06:30.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768413989 status=200 resp_size=4834
|
||
2026-01-15 02:06:30.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413990&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:06:33.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768413993 status=200 resp_size=5006
|
||
2026-01-15 02:06:33.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413993&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 02:06:39.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768413999 status=200 resp_size=5363
|
||
2026-01-15 02:06:39.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768413999&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 02:06:47.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768414007 status=200 resp_size=5241
|
||
2026-01-15 02:06:47.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414007&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 02:06:56.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768414015 status=200 resp_size=5232
|
||
2026-01-15 02:06:56.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414016&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 02:07:03.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768414022 status=200 resp_size=6946
|
||
2026-01-15 02:07:03.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414023&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 02:07:12.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768414031 status=200 resp_size=4956
|
||
2026-01-15 02:07:12.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414032&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:07:16.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768414036 status=200 resp_size=7382
|
||
2026-01-15 02:07:17.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414036&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 02:07:27.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768414047 status=200 resp_size=7331
|
||
2026-01-15 02:07:28.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414047&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 02:07:30.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768414050 status=200 resp_size=5087
|
||
2026-01-15 02:07:30.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414050&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 02:07:32.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768414052 status=200 resp_size=6551
|
||
2026-01-15 02:07:33.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414052&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 02:07:34.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768414054 status=200 resp_size=4515
|
||
2026-01-15 02:07:34.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414054&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 02:07:38.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768414058 status=200 resp_size=4865
|
||
2026-01-15 02:07:39.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414058&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 02:07:43.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768414062 status=200 resp_size=5494
|
||
2026-01-15 02:07:43.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414063&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 02:07:49.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768414068 status=200 resp_size=6572
|
||
2026-01-15 02:07:49.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414069&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 02:07:58.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768414078 status=200 resp_size=5674
|
||
2026-01-15 02:07:58.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414078&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:08:01.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768414081 status=200 resp_size=6139
|
||
2026-01-15 02:08:01.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414081&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 02:08:11.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768414091 status=200 resp_size=6303
|
||
2026-01-15 02:08:11.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414091&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 02:08:21.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768414101 status=200 resp_size=5469
|
||
2026-01-15 02:08:22.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414101&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 02:08:25.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768414104 status=200 resp_size=5725
|
||
2026-01-15 02:08:25.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414105&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 02:08:25.368 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:08:31.113 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:08:31.113 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 02:08:34.993 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.88 秒后继续...
|
||
2026-01-15 02:08:34.993 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 02:08:34.993 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:08:35.009 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:08:35.480 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:08:36.602 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:08:38.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:08:38.713 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:08:39.153 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414115 status=200 resp_size=137375
|
||
2026-01-15 02:08:39.153 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:08:39.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768414119 status=200 resp_size=4737
|
||
2026-01-15 02:08:39.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414119&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 02:08:48.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768414127 status=200 resp_size=4297
|
||
2026-01-15 02:08:48.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414128&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 02:08:51.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768414131 status=200 resp_size=6856
|
||
2026-01-15 02:08:51.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414131&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 02:08:58.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768414137 status=200 resp_size=5259
|
||
2026-01-15 02:08:58.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414138&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 02:09:08.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job×tamp=1768414148 status=200 resp_size=4786
|
||
2026-01-15 02:09:08.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414148&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 02:09:10.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768414150 status=200 resp_size=5746
|
||
2026-01-15 02:09:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414150&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:09:18.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768414158 status=200 resp_size=7248
|
||
2026-01-15 02:09:19.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414158&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:09:23.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768414163 status=200 resp_size=6326
|
||
2026-01-15 02:09:23.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414163&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 02:09:28.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768414168 status=200 resp_size=5483
|
||
2026-01-15 02:09:28.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414168&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 02:09:31.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768414171 status=200 resp_size=5037
|
||
2026-01-15 02:09:31.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414171&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 02:09:41.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768414180 status=200 resp_size=5631
|
||
2026-01-15 02:09:41.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414181&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 02:09:43.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768414183 status=200 resp_size=5979
|
||
2026-01-15 02:09:43.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414183&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 02:09:45.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768414184 status=200 resp_size=6264
|
||
2026-01-15 02:09:45.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414185&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 02:09:52.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768414191 status=200 resp_size=5973
|
||
2026-01-15 02:09:52.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414192&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 02:09:57.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768414197 status=200 resp_size=5928
|
||
2026-01-15 02:09:57.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414197&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 02:10:00.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768414200 status=200 resp_size=6295
|
||
2026-01-15 02:10:00.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414200&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 02:10:03.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768414202 status=200 resp_size=5806
|
||
2026-01-15 02:10:03.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414203&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:10:07.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768414207 status=200 resp_size=5174
|
||
2026-01-15 02:10:08.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414207&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 02:10:14.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768414213 status=200 resp_size=6666
|
||
2026-01-15 02:10:14.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414214&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 02:10:19.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768414218 status=200 resp_size=4654
|
||
2026-01-15 02:10:19.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414219&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 02:10:19.259 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:10:25.398 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:10:25.398 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 02:10:29.373 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.96 秒后继续...
|
||
2026-01-15 02:10:29.373 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 02:10:29.373 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:10:29.389 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:10:29.908 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:10:31.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:10:33.174 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:10:33.174 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:10:33.645 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414229 status=200 resp_size=118859
|
||
2026-01-15 02:10:33.645 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:10:33.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768414233 status=200 resp_size=7057
|
||
2026-01-15 02:10:33.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414233&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 02:10:40.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768414240 status=200 resp_size=6546
|
||
2026-01-15 02:10:41.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414240&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 02:10:45.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job×tamp=1768414245 status=200 resp_size=4679
|
||
2026-01-15 02:10:45.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414245&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
|
||
2026-01-15 02:10:49.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768414249 status=200 resp_size=4783
|
||
2026-01-15 02:10:49.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414249&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 02:10:58.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768414257 status=200 resp_size=5359
|
||
2026-01-15 02:10:58.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414258&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:11:00.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768414260 status=200 resp_size=6325
|
||
2026-01-15 02:11:01.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414260&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 02:11:04.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768414264 status=200 resp_size=5106
|
||
2026-01-15 02:11:05.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414264&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 02:11:07.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768414267 status=200 resp_size=5306
|
||
2026-01-15 02:11:07.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414267&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 02:11:10.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768414270 status=200 resp_size=6073
|
||
2026-01-15 02:11:11.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414270&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 02:11:16.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768414275 status=200 resp_size=5111
|
||
2026-01-15 02:11:16.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414276&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 02:11:19.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768414278 status=200 resp_size=5915
|
||
2026-01-15 02:11:19.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414279&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 02:11:25.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768414284 status=200 resp_size=5282
|
||
2026-01-15 02:11:25.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414285&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 02:11:32.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job×tamp=1768414291 status=200 resp_size=7722
|
||
2026-01-15 02:11:32.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414292&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 02:11:38.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768414298 status=200 resp_size=4719
|
||
2026-01-15 02:11:39.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414298&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 02:11:45.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768414304 status=200 resp_size=5693
|
||
2026-01-15 02:11:46.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414305&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:11:54.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768414314 status=200 resp_size=7688
|
||
2026-01-15 02:11:55.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414314&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 02:11:58.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768414317 status=200 resp_size=5294
|
||
2026-01-15 02:11:58.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414318&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:12:04.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768414323 status=200 resp_size=5943
|
||
2026-01-15 02:12:04.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414324&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 02:12:12.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768414332 status=200 resp_size=4757
|
||
2026-01-15 02:12:12.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414332&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 02:12:19.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768414338 status=200 resp_size=5591
|
||
2026-01-15 02:12:19.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414339&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:12:19.574 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:12:25.115 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:12:25.115 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 02:12:26.237 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.12 秒后继续...
|
||
2026-01-15 02:12:26.237 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 02:12:26.237 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:12:26.263 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:12:26.843 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:12:27.974 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:12:30.112 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:12:30.112 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:12:30.646 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414346 status=200 resp_size=133535
|
||
2026-01-15 02:12:30.646 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:12:30.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768414350 status=200 resp_size=5853
|
||
2026-01-15 02:12:30.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414350&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 02:12:38.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768414357 status=200 resp_size=5360
|
||
2026-01-15 02:12:38.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414358&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 02:12:47.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768414366 status=200 resp_size=5666
|
||
2026-01-15 02:12:47.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414367&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:12:53.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768414372 status=200 resp_size=5317
|
||
2026-01-15 02:12:53.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414373&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:12:54.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768414374 status=200 resp_size=5651
|
||
2026-01-15 02:12:54.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414374&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 02:13:02.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job×tamp=1768414382 status=200 resp_size=4864
|
||
2026-01-15 02:13:03.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414382&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:13:06.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768414386 status=200 resp_size=4333
|
||
2026-01-15 02:13:06.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414386&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 02:13:07.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768414387 status=200 resp_size=5510
|
||
2026-01-15 02:13:08.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414387&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:13:12.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768414392 status=200 resp_size=6269
|
||
2026-01-15 02:13:12.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414392&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 02:13:21.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768414400 status=200 resp_size=5151
|
||
2026-01-15 02:13:22.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414401&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:13:33.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768414412 status=200 resp_size=5481
|
||
2026-01-15 02:13:33.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414413&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 02:13:36.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768414416 status=200 resp_size=6454
|
||
2026-01-15 02:13:36.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414416&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:13:38.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768414417 status=200 resp_size=8675
|
||
2026-01-15 02:13:38.251 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414418&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 02:13:46.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768414425 status=200 resp_size=5938
|
||
2026-01-15 02:13:46.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414426&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 02:13:54.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768414434 status=200 resp_size=8440
|
||
2026-01-15 02:13:55.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414434&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 02:14:05.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768414444 status=200 resp_size=6458
|
||
2026-01-15 02:14:05.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414445&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:14:08.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768414448 status=200 resp_size=5227
|
||
2026-01-15 02:14:08.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414448&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 02:14:13.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768414453 status=200 resp_size=5162
|
||
2026-01-15 02:14:13.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414453&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 02:14:15.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768414455 status=200 resp_size=6414
|
||
2026-01-15 02:14:15.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414455&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 02:14:26.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768414465 status=200 resp_size=6062
|
||
2026-01-15 02:14:26.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414466&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 02:14:26.827 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:14:32.829 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:14:32.829 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 02:14:40.843 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.00 秒后继续...
|
||
2026-01-15 02:14:40.843 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 02:14:40.843 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:14:40.868 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:14:41.371 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:14:42.503 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:14:44.623 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:14:44.623 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:14:45.047 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414480 status=200 resp_size=108713
|
||
2026-01-15 02:14:45.047 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:14:45.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768414485 status=200 resp_size=5449
|
||
2026-01-15 02:14:45.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414485&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 02:14:52.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768414492 status=200 resp_size=5712
|
||
2026-01-15 02:14:52.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414492&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 02:15:01.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768414501 status=200 resp_size=6976
|
||
2026-01-15 02:15:01.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414501&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 02:15:07.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768414507 status=200 resp_size=5837
|
||
2026-01-15 02:15:08.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414507&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 02:15:18.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768414517 status=200 resp_size=5503
|
||
2026-01-15 02:15:18.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414518&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 02:15:26.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768414525 status=200 resp_size=5845
|
||
2026-01-15 02:15:26.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414526&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 02:15:32.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768414532 status=200 resp_size=6139
|
||
2026-01-15 02:15:33.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414532&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 02:15:40.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768414540 status=200 resp_size=5603
|
||
2026-01-15 02:15:41.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414540&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 02:15:49.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768414548 status=200 resp_size=5636
|
||
2026-01-15 02:15:49.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414549&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 02:15:54.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768414553 status=200 resp_size=6222
|
||
2026-01-15 02:15:54.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414554&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 02:15:58.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768414558 status=200 resp_size=7746
|
||
2026-01-15 02:15:59.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414558&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 02:16:06.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768414566 status=200 resp_size=5400
|
||
2026-01-15 02:16:07.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414566&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 02:16:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768414570 status=200 resp_size=5846
|
||
2026-01-15 02:16:10.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414570&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 02:16:12.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768414571 status=200 resp_size=4627
|
||
2026-01-15 02:16:12.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414572&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 02:16:21.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768414581 status=200 resp_size=6070
|
||
2026-01-15 02:16:22.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414581&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:16:29.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768414588 status=200 resp_size=6340
|
||
2026-01-15 02:16:29.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414589&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 02:16:32.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768414592 status=200 resp_size=6896
|
||
2026-01-15 02:16:32.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414592&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 02:16:42.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768414601 status=200 resp_size=5290
|
||
2026-01-15 02:16:42.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414602&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 02:16:52.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768414611 status=200 resp_size=5964
|
||
2026-01-15 02:16:52.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414612&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:17:01.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768414620 status=200 resp_size=6432
|
||
2026-01-15 02:17:01.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414621&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 02:17:01.393 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:17:06.794 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:17:06.810 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 02:17:16.174 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.36 秒后继续...
|
||
2026-01-15 02:17:16.174 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 02:17:16.174 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:17:16.187 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:17:16.879 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:17:18.042 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:17:20.210 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:17:20.210 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:17:20.666 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414636 status=200 resp_size=106463
|
||
2026-01-15 02:17:20.666 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:17:20.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768414640 status=200 resp_size=6490
|
||
2026-01-15 02:17:21.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414640&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 02:17:30.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768414650 status=200 resp_size=6190
|
||
2026-01-15 02:17:31.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414650&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 02:17:36.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768414655 status=200 resp_size=6066
|
||
2026-01-15 02:17:36.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414656&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:17:45.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768414665 status=200 resp_size=5526
|
||
2026-01-15 02:17:46.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414665&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 02:17:50.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768414669 status=200 resp_size=6819
|
||
2026-01-15 02:17:50.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414670&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 02:18:00.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768414679 status=200 resp_size=5820
|
||
2026-01-15 02:18:00.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414680&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 02:18:02.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768414682 status=200 resp_size=4782
|
||
2026-01-15 02:18:02.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414682&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:18:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768414689 status=200 resp_size=6984
|
||
2026-01-15 02:18:10.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414690&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 02:18:15.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768414695 status=200 resp_size=5414
|
||
2026-01-15 02:18:15.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414695&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 02:18:17.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768414697 status=200 resp_size=6066
|
||
2026-01-15 02:18:18.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414697&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 02:18:19.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768414699 status=200 resp_size=5541
|
||
2026-01-15 02:18:19.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414699&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 02:18:29.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768414709 status=200 resp_size=6058
|
||
2026-01-15 02:18:29.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414709&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 02:18:36.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768414715 status=200 resp_size=5879
|
||
2026-01-15 02:18:36.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414716&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 02:18:40.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768414720 status=200 resp_size=5379
|
||
2026-01-15 02:18:40.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414720&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 02:18:43.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768414723 status=200 resp_size=5655
|
||
2026-01-15 02:18:43.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414723&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 02:18:52.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768414731 status=200 resp_size=6286
|
||
2026-01-15 02:18:52.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 02:19:00.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768414739 status=200 resp_size=5496
|
||
2026-01-15 02:19:00.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414740&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 02:19:08.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768414748 status=200 resp_size=6106
|
||
2026-01-15 02:19:08.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414748&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 02:19:10.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768414750 status=200 resp_size=6326
|
||
2026-01-15 02:19:10.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414750&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 02:19:17.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768414756 status=200 resp_size=5398
|
||
2026-01-15 02:19:17.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414757&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 02:19:17.455 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:19:18.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:19:18.035 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 02:19:19.759 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.71 秒后继续...
|
||
2026-01-15 02:19:19.759 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 02:19:19.759 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:19:19.778 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:19:20.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:19:21.600 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:19:23.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:19:23.767 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:19:24.254 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414759 status=200 resp_size=121017
|
||
2026-01-15 02:19:24.254 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:19:24.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768414764 status=200 resp_size=5294
|
||
2026-01-15 02:19:24.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414764&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:19:26.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768414766 status=200 resp_size=5984
|
||
2026-01-15 02:19:27.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414766&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 02:19:36.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768414775 status=200 resp_size=5662
|
||
2026-01-15 02:19:36.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414776&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 02:19:45.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768414785 status=200 resp_size=5833
|
||
2026-01-15 02:19:46.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414785&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 02:19:53.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768414792 status=200 resp_size=6131
|
||
2026-01-15 02:19:53.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414793&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 02:20:01.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768414801 status=200 resp_size=6100
|
||
2026-01-15 02:20:01.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414801&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:20:08.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768414808 status=200 resp_size=5951
|
||
2026-01-15 02:20:08.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414808&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 02:20:13.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768414812 status=200 resp_size=6219
|
||
2026-01-15 02:20:13.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414813&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 02:20:17.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768414817 status=200 resp_size=6029
|
||
2026-01-15 02:20:17.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414817&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 02:20:26.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768414825 status=200 resp_size=5681
|
||
2026-01-15 02:20:26.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414826&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:20:30.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768414830 status=200 resp_size=5849
|
||
2026-01-15 02:20:30.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414830&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 02:20:34.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768414834 status=200 resp_size=5335
|
||
2026-01-15 02:20:34.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414834&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:20:36.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768414836 status=200 resp_size=6351
|
||
2026-01-15 02:20:37.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414836&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 02:20:46.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768414845 status=200 resp_size=5829
|
||
2026-01-15 02:20:46.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414846&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 02:20:56.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768414855 status=200 resp_size=6321
|
||
2026-01-15 02:20:56.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414856&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:20:59.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768414859 status=200 resp_size=6113
|
||
2026-01-15 02:20:59.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414859&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:21:09.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768414869 status=200 resp_size=5095
|
||
2026-01-15 02:21:10.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414869&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 02:21:17.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768414877 status=200 resp_size=5107
|
||
2026-01-15 02:21:18.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414877&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 02:21:21.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768414881 status=200 resp_size=6497
|
||
2026-01-15 02:21:21.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414881&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:21:28.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768414888 status=200 resp_size=6385
|
||
2026-01-15 02:21:28.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414888&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:21:28.997 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:21:34.716 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:21:34.716 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 02:21:40.290 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.56 秒后继续...
|
||
2026-01-15 02:21:40.290 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 02:21:40.290 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:21:40.309 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:21:40.796 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:21:41.896 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:21:44.000 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:21:44.000 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:21:44.456 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768414900 status=200 resp_size=143660
|
||
2026-01-15 02:21:44.456 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:21:44.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768414904 status=200 resp_size=4774
|
||
2026-01-15 02:21:44.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414904&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 02:21:46.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768414906 status=200 resp_size=5463
|
||
2026-01-15 02:21:46.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414906&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 02:21:54.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768414913 status=200 resp_size=5473
|
||
2026-01-15 02:21:54.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414914&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:22:01.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768414921 status=200 resp_size=6963
|
||
2026-01-15 02:22:02.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414921&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:22:10.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768414929 status=200 resp_size=5448
|
||
2026-01-15 02:22:10.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414930&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:22:19.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768414938 status=200 resp_size=6053
|
||
2026-01-15 02:22:19.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414939&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 02:22:24.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768414944 status=200 resp_size=6074
|
||
2026-01-15 02:22:24.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414944&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:22:31.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768414950 status=200 resp_size=7079
|
||
2026-01-15 02:22:31.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414951&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 02:22:42.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768414961 status=200 resp_size=5197
|
||
2026-01-15 02:22:42.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414962&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:22:52.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768414972 status=200 resp_size=7337
|
||
2026-01-15 02:22:53.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414972&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 02:22:55.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768414974 status=200 resp_size=5503
|
||
2026-01-15 02:22:55.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414975&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:23:01.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768414980 status=200 resp_size=6216
|
||
2026-01-15 02:23:01.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414981&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 02:23:04.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768414984 status=200 resp_size=5703
|
||
2026-01-15 02:23:04.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414984&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:23:07.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768414986 status=200 resp_size=5924
|
||
2026-01-15 02:23:07.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414987&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 02:23:10.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768414990 status=200 resp_size=5236
|
||
2026-01-15 02:23:10.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414990&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:23:14.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768414994 status=200 resp_size=6275
|
||
2026-01-15 02:23:14.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768414994&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 02:23:22.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768415001 status=200 resp_size=4841
|
||
2026-01-15 02:23:22.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:23:29.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768415008 status=200 resp_size=6316
|
||
2026-01-15 02:23:29.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415009&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 02:23:35.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768415014 status=200 resp_size=5321
|
||
2026-01-15 02:23:35.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415015&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:23:43.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job×tamp=1768415023 status=200 resp_size=6213
|
||
2026-01-15 02:23:43.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415023&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
|
||
2026-01-15 02:23:43.866 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:23:49.852 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:23:49.852 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 02:23:52.469 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.61 秒后继续...
|
||
2026-01-15 02:23:52.469 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 02:23:52.469 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:23:52.489 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:23:53.150 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:23:54.296 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:23:56.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:23:56.448 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:23:56.887 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415032 status=200 resp_size=134521
|
||
2026-01-15 02:23:56.887 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:23:57.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768415036 status=200 resp_size=5112
|
||
2026-01-15 02:23:57.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415037&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:24:02.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768415042 status=200 resp_size=6150
|
||
2026-01-15 02:24:02.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415042&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 02:24:07.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768415047 status=200 resp_size=5188
|
||
2026-01-15 02:24:07.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415047&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:24:11.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768415051 status=200 resp_size=5166
|
||
2026-01-15 02:24:11.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415051&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:24:15.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768415055 status=200 resp_size=5373
|
||
2026-01-15 02:24:15.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415055&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:24:31.665 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
|
||
2026-01-15 02:24:31.665 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
|
||
2026-01-15 02:24:31.680 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:24:31.680 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-15 02:24:31.680 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:24:32.309 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768415061 status=200 resp_size=5148
|
||
2026-01-15 02:24:32.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415072&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:24:35.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768415075 status=200 resp_size=4861
|
||
2026-01-15 02:24:35.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415075&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:24:38.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768415078 status=200 resp_size=5055
|
||
2026-01-15 02:24:38.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415078&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:24:48.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768415088 status=200 resp_size=4962
|
||
2026-01-15 02:24:49.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415088&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:24:53.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768415092 status=200 resp_size=4847
|
||
2026-01-15 02:24:53.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415093&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:25:09.735 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
|
||
2026-01-15 02:25:09.735 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
|
||
2026-01-15 02:25:09.735 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:09.735 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-15 02:25:09.735 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:10.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768415099 status=200 resp_size=5409
|
||
2026-01-15 02:25:10.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415110&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:25:28.188 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
|
||
2026-01-15 02:25:28.188 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
|
||
2026-01-15 02:25:28.188 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:28.188 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-15 02:25:28.188 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:38.350 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 2/3): 517 Proxy Setup Failed
|
||
2026-01-15 02:25:38.350 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
|
||
2026-01-15 02:25:38.350 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:38.350 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-15 02:25:38.350 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:25:39.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768415118 status=200 resp_size=5600
|
||
2026-01-15 02:25:39.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415139&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:25:45.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768415145 status=200 resp_size=5570
|
||
2026-01-15 02:25:45.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415145&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:25:49.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768415149 status=200 resp_size=5032
|
||
2026-01-15 02:25:49.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415149&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:25:54.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768415154 status=200 resp_size=5461
|
||
2026-01-15 02:25:55.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415154&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:26:05.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768415164 status=200 resp_size=5182
|
||
2026-01-15 02:26:05.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415165&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:26:14.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768415173 status=200 resp_size=5200
|
||
2026-01-15 02:26:14.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415174&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:26:19.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768415179 status=200 resp_size=5552
|
||
2026-01-15 02:26:19.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415179&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:26:28.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768415187 status=200 resp_size=5207
|
||
2026-01-15 02:26:28.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415188&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:26:37.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768415196 status=200 resp_size=5489
|
||
2026-01-15 02:26:37.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415197&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:26:37.728 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:26:43.851 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:26:43.851 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 02:26:46.839 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.98 秒后继续...
|
||
2026-01-15 02:26:46.839 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 02:26:46.839 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:26:46.866 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:26:47.400 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:26:48.514 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:26:50.635 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:26:50.635 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:26:51.121 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415206 status=200 resp_size=128204
|
||
2026-01-15 02:26:51.121 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:26:51.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768415211 status=200 resp_size=5173
|
||
2026-01-15 02:26:51.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415211&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:26:57.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768415216 status=200 resp_size=5295
|
||
2026-01-15 02:26:57.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415217&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:26:59.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768415218 status=200 resp_size=4383
|
||
2026-01-15 02:26:59.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415219&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 02:27:06.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job×tamp=1768415226 status=200 resp_size=6576
|
||
2026-01-15 02:27:07.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415226&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 02:27:09.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768415228 status=200 resp_size=10634
|
||
2026-01-15 02:27:09.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415229&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 02:27:16.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768415235 status=200 resp_size=4985
|
||
2026-01-15 02:27:16.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415236&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:27:23.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768415242 status=200 resp_size=4990
|
||
2026-01-15 02:27:23.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415243&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 02:27:31.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768415251 status=200 resp_size=5236
|
||
2026-01-15 02:27:31.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415251&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 02:27:34.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768415254 status=200 resp_size=4315
|
||
2026-01-15 02:27:34.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415254&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 02:27:35.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768415255 status=200 resp_size=4972
|
||
2026-01-15 02:27:35.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415255&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:27:40.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768415260 status=200 resp_size=7628
|
||
2026-01-15 02:27:40.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415260&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 02:27:47.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768415267 status=200 resp_size=6205
|
||
2026-01-15 02:27:47.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415267&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 02:27:55.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job×tamp=1768415274 status=200 resp_size=4425
|
||
2026-01-15 02:27:55.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415275&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:28:04.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768415284 status=200 resp_size=5158
|
||
2026-01-15 02:28:04.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415284&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:28:12.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768415292 status=200 resp_size=6095
|
||
2026-01-15 02:28:13.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415292&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:28:15.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768415295 status=200 resp_size=5147
|
||
2026-01-15 02:28:15.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415295&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 02:28:19.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768415299 status=200 resp_size=6401
|
||
2026-01-15 02:28:20.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415299&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:28:26.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768415306 status=200 resp_size=4978
|
||
2026-01-15 02:28:27.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415306&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:28:33.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768415313 status=200 resp_size=6101
|
||
2026-01-15 02:28:33.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415313&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:28:36.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768415316 status=200 resp_size=4991
|
||
2026-01-15 02:28:36.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415316&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 02:28:36.348 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:28:36.694 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:28:36.694 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 02:28:42.311 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.60 秒后继续...
|
||
2026-01-15 02:28:42.311 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 02:28:42.311 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:28:42.334 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:28:43.001 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:28:44.157 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:28:46.311 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:28:46.311 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:28:46.843 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415322 status=200 resp_size=139622
|
||
2026-01-15 02:28:46.860 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:28:47.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768415326 status=200 resp_size=6793
|
||
2026-01-15 02:28:47.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415327&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:28:50.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768415330 status=200 resp_size=5026
|
||
2026-01-15 02:28:50.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415330&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:28:59.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768415339 status=200 resp_size=6117
|
||
2026-01-15 02:29:00.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415339&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:29:04.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768415344 status=200 resp_size=5111
|
||
2026-01-15 02:29:05.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415344&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:29:07.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768415347 status=200 resp_size=6546
|
||
2026-01-15 02:29:07.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415347&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 02:29:15.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768415355 status=200 resp_size=4859
|
||
2026-01-15 02:29:15.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415355&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:29:25.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768415364 status=200 resp_size=6108
|
||
2026-01-15 02:29:25.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415365&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:29:35.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job×tamp=1768415374 status=200 resp_size=5325
|
||
2026-01-15 02:29:35.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415375&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
|
||
2026-01-15 02:29:40.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768415380 status=200 resp_size=6315
|
||
2026-01-15 02:29:40.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415380&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 02:29:42.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768415382 status=200 resp_size=5992
|
||
2026-01-15 02:29:43.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415382&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 02:29:49.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768415388 status=200 resp_size=6109
|
||
2026-01-15 02:29:49.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415389&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:29:53.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768415393 status=200 resp_size=4835
|
||
2026-01-15 02:29:54.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415393&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 02:30:03.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768415403 status=200 resp_size=7131
|
||
2026-01-15 02:30:03.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415403&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 02:30:11.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768415411 status=200 resp_size=6770
|
||
2026-01-15 02:30:12.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415411&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:30:15.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768415415 status=200 resp_size=6115
|
||
2026-01-15 02:30:15.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415415&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:30:25.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768415424 status=200 resp_size=5215
|
||
2026-01-15 02:30:25.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415425&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 02:30:29.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768415428 status=200 resp_size=6749
|
||
2026-01-15 02:30:29.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415429&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 02:30:31.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768415431 status=200 resp_size=6794
|
||
2026-01-15 02:30:31.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415431&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:30:32.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768415432 status=200 resp_size=6044
|
||
2026-01-15 02:30:32.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415432&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:30:42.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768415441 status=200 resp_size=6544
|
||
2026-01-15 02:30:42.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415442&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 02:30:42.179 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:30:48.492 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:30:48.492 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 02:30:51.828 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.33 秒后继续...
|
||
2026-01-15 02:30:51.828 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 02:30:51.828 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:30:51.853 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=阜阳, 工作类型=6101
|
||
2026-01-15 02:30:52.403 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:30:53.519 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:30:55.655 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:30:55.655 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:30:56.159 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415451 status=200 resp_size=115115
|
||
2026-01-15 02:30:56.159 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17) | API返回totalCount: 517 (原始值: 517) | 地区: 阜阳(阜阳) | 职能: 网店店长(6101)
|
||
2026-01-15 02:30:56.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768415456 status=200 resp_size=7105
|
||
2026-01-15 02:30:56.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415456&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 02:31:05.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768415464 status=200 resp_size=6107
|
||
2026-01-15 02:31:05.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415465&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:31:06.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768415466 status=200 resp_size=6531
|
||
2026-01-15 02:31:06.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415466&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 02:31:12.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768415471 status=200 resp_size=4704
|
||
2026-01-15 02:31:12.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415472&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 02:31:14.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768415474 status=200 resp_size=6427
|
||
2026-01-15 02:31:14.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415474&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 02:31:21.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768415480 status=200 resp_size=6113
|
||
2026-01-15 02:31:21.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415481&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:31:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768415486 status=200 resp_size=5737
|
||
2026-01-15 02:31:27.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415487&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 02:31:34.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768415494 status=200 resp_size=5499
|
||
2026-01-15 02:31:35.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415494&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 02:31:41.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768415501 status=200 resp_size=5880
|
||
2026-01-15 02:31:42.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415501&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:31:44.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768415504 status=200 resp_size=6107
|
||
2026-01-15 02:31:44.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415504&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:31:47.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768415507 status=200 resp_size=5139
|
||
2026-01-15 02:31:47.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415507&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:31:55.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768415514 status=200 resp_size=5903
|
||
2026-01-15 02:31:55.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415515&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 02:32:04.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768415523 status=200 resp_size=5129
|
||
2026-01-15 02:32:04.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415524&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 02:32:14.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768415533 status=200 resp_size=6109
|
||
2026-01-15 02:32:14.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415534&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:32:22.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768415542 status=200 resp_size=5241
|
||
2026-01-15 02:32:23.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415542&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:32:31.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768415550 status=200 resp_size=6111
|
||
2026-01-15 02:32:31.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415551&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:32:36.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768415556 status=200 resp_size=6122
|
||
2026-01-15 02:32:36.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415556&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 02:32:36.440 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
|
||
2026-01-15 02:32:36.800 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 511 条
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 6 条
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 02:32:36.800 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 阜阳(阜阳)
|
||
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 网店店长(6101)
|
||
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.84% (511/517)
|
||
2026-01-15 02:32:36.816 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(511) < API返回总数(517),可能存在分页问题或数据过滤
|
||
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 02:32:36.816 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 02:32:36.816 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 511 条记录)
|
||
2026-01-15 02:32:36.816 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 511 个职位
|
||
2026-01-15 02:32:36.819 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 02:32:41.886 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:32:41.904 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:32:42.422 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 02:32:42.422 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 02:32:42.422 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:32:42.452 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:32:43.049 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:32:44.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:32:46.348 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:32:46.348 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:32:46.849 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415562 status=200 resp_size=116600
|
||
2026-01-15 02:32:46.849 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:32:47.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768415566 status=200 resp_size=5699
|
||
2026-01-15 02:32:47.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415567&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 02:32:51.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768415571 status=200 resp_size=5184
|
||
2026-01-15 02:32:51.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415571&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 02:32:58.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768415578 status=200 resp_size=5579
|
||
2026-01-15 02:32:58.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415578&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 02:33:07.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768415586 status=200 resp_size=5000
|
||
2026-01-15 02:33:07.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415587&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 02:33:12.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768415592 status=200 resp_size=5029
|
||
2026-01-15 02:33:12.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415592&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:33:21.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768415601 status=200 resp_size=5546
|
||
2026-01-15 02:33:22.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415601&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 02:33:31.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768415610 status=200 resp_size=5630
|
||
2026-01-15 02:33:31.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415611&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 02:33:35.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768415615 status=200 resp_size=6579
|
||
2026-01-15 02:33:36.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415615&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 02:33:39.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768415619 status=200 resp_size=4954
|
||
2026-01-15 02:33:39.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415619&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 02:33:49.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768415628 status=200 resp_size=5739
|
||
2026-01-15 02:33:49.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415629&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 02:33:52.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768415632 status=200 resp_size=6192
|
||
2026-01-15 02:33:52.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415632&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 02:33:57.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768415637 status=200 resp_size=5803
|
||
2026-01-15 02:33:57.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415637&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 02:34:05.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768415644 status=200 resp_size=5976
|
||
2026-01-15 02:34:05.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415645&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 02:34:11.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768415650 status=200 resp_size=5890
|
||
2026-01-15 02:34:11.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415651&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:34:19.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768415659 status=200 resp_size=4892
|
||
2026-01-15 02:34:20.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415659&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 02:34:28.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768415667 status=200 resp_size=5431
|
||
2026-01-15 02:34:28.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415668&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 02:34:32.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768415672 status=200 resp_size=6399
|
||
2026-01-15 02:34:33.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415672&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:34:38.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768415678 status=200 resp_size=6023
|
||
2026-01-15 02:34:38.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415678&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:34:48.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768415688 status=200 resp_size=6048
|
||
2026-01-15 02:34:48.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415688&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:34:56.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768415695 status=200 resp_size=6192
|
||
2026-01-15 02:34:56.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415696&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 02:34:56.589 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:35:02.477 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:35:02.477 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 02:35:02.477 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 02:35:05.949 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.47 秒后继续...
|
||
2026-01-15 02:35:05.949 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 02:35:05.949 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:35:05.980 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:35:06.420 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:35:07.535 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:35:09.641 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:35:09.641 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:35:09.986 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415705 status=200 resp_size=106552
|
||
2026-01-15 02:35:09.986 | WARNING | __main__:get_recommend_jobs:745 - 第 2 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 02:35:09.986 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:35:10.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768415710 status=200 resp_size=6015
|
||
2026-01-15 02:35:10.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415710&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-15 02:35:13.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768415713 status=200 resp_size=5744
|
||
2026-01-15 02:35:13.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415713&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 02:35:17.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768415717 status=200 resp_size=5721
|
||
2026-01-15 02:35:17.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415717&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 02:35:19.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768415719 status=200 resp_size=5634
|
||
2026-01-15 02:35:20.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415719&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 02:35:27.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768415726 status=200 resp_size=6137
|
||
2026-01-15 02:35:27.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415727&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 02:35:32.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768415732 status=200 resp_size=6787
|
||
2026-01-15 02:35:32.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415732&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 02:35:39.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768415738 status=200 resp_size=5480
|
||
2026-01-15 02:35:39.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415739&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 02:35:42.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768415742 status=200 resp_size=5190
|
||
2026-01-15 02:35:42.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415742&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 02:35:50.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768415750 status=200 resp_size=6366
|
||
2026-01-15 02:35:50.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415750&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-15 02:36:00.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768415759 status=200 resp_size=6134
|
||
2026-01-15 02:36:00.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415760&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 02:36:07.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768415767 status=200 resp_size=5591
|
||
2026-01-15 02:36:08.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415767&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 02:36:11.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768415771 status=200 resp_size=5110
|
||
2026-01-15 02:36:11.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415771&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 02:36:14.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768415774 status=200 resp_size=6423
|
||
2026-01-15 02:36:14.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415774&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:36:17.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768415776 status=200 resp_size=5960
|
||
2026-01-15 02:36:17.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415777&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 02:36:27.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768415787 status=200 resp_size=5613
|
||
2026-01-15 02:36:28.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415787&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:36:34.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768415793 status=200 resp_size=5374
|
||
2026-01-15 02:36:34.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415794&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:36:39.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768415799 status=200 resp_size=5478
|
||
2026-01-15 02:36:39.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415799&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 02:36:47.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768415807 status=200 resp_size=5603
|
||
2026-01-15 02:36:48.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415807&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 02:36:54.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768415813 status=200 resp_size=5694
|
||
2026-01-15 02:36:54.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415814&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:36:54.227 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 02:36:59.707 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 02:36:59.707 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 02:37:07.710 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.00 秒后继续...
|
||
2026-01-15 02:37:07.710 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 02:37:07.710 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:37:07.729 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:37:08.310 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:37:09.441 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:37:11.579 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:37:11.579 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:37:12.051 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415827 status=200 resp_size=121946
|
||
2026-01-15 02:37:12.051 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:37:12.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768415832 status=200 resp_size=6179
|
||
2026-01-15 02:37:12.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415832&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 02:37:15.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768415835 status=200 resp_size=5506
|
||
2026-01-15 02:37:15.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415835&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:37:23.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768415842 status=200 resp_size=6076
|
||
2026-01-15 02:37:23.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415843&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 02:37:31.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768415851 status=200 resp_size=5653
|
||
2026-01-15 02:37:31.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415851&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 02:37:33.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768415853 status=200 resp_size=5677
|
||
2026-01-15 02:37:34.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415853&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 02:37:42.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768415861 status=200 resp_size=5513
|
||
2026-01-15 02:37:42.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415862&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 02:37:51.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768415871 status=200 resp_size=6285
|
||
2026-01-15 02:37:52.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415871&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 02:38:00.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768415880 status=200 resp_size=5127
|
||
2026-01-15 02:38:00.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415880&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 02:38:06.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768415886 status=200 resp_size=5974
|
||
2026-01-15 02:38:06.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415886&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:38:12.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768415891 status=200 resp_size=5182
|
||
2026-01-15 02:38:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415892&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 02:38:17.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768415896 status=200 resp_size=5985
|
||
2026-01-15 02:38:17.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415897&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 02:38:20.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768415900 status=200 resp_size=5340
|
||
2026-01-15 02:38:20.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415900&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:38:29.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768415908 status=200 resp_size=7311
|
||
2026-01-15 02:38:29.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415909&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-15 02:38:37.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768415916 status=200 resp_size=5725
|
||
2026-01-15 02:38:37.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415917&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 02:38:39.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768415919 status=200 resp_size=5729
|
||
2026-01-15 02:38:39.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415919&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:38:48.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768415928 status=200 resp_size=5222
|
||
2026-01-15 02:38:49.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415928&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 02:38:57.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768415936 status=200 resp_size=7499
|
||
2026-01-15 02:38:57.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415937&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 02:38:59.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768415939 status=200 resp_size=5723
|
||
2026-01-15 02:38:59.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415939&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 02:39:01.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768415941 status=200 resp_size=6025
|
||
2026-01-15 02:39:01.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415941&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 02:39:10.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768415949 status=200 resp_size=5245
|
||
2026-01-15 02:39:10.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415950&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 02:39:10.641 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:39:16.260 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:39:16.260 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 02:39:25.893 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.62 秒后继续...
|
||
2026-01-15 02:39:25.893 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 02:39:25.893 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:39:25.918 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:39:26.469 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:39:27.614 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:39:29.752 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:39:29.752 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:39:30.223 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768415965 status=200 resp_size=118718
|
||
2026-01-15 02:39:30.239 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:39:30.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768415970 status=200 resp_size=8364
|
||
2026-01-15 02:39:30.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415970&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-15 02:39:35.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768415975 status=200 resp_size=6139
|
||
2026-01-15 02:39:35.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415975&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 02:39:42.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768415981 status=200 resp_size=6651
|
||
2026-01-15 02:39:42.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415982&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 02:39:45.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768415984 status=200 resp_size=5833
|
||
2026-01-15 02:39:45.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415985&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:39:48.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768415988 status=200 resp_size=5756
|
||
2026-01-15 02:39:49.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415988&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:39:58.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768415998 status=200 resp_size=6448
|
||
2026-01-15 02:39:59.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768415998&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 02:40:06.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768416006 status=200 resp_size=6466
|
||
2026-01-15 02:40:06.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416006&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:40:09.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768416009 status=200 resp_size=5793
|
||
2026-01-15 02:40:09.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416009&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:40:12.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768416012 status=200 resp_size=5632
|
||
2026-01-15 02:40:13.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416012&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-15 02:40:21.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768416020 status=200 resp_size=5803
|
||
2026-01-15 02:40:21.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416021&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:40:23.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768416023 status=200 resp_size=5961
|
||
2026-01-15 02:40:23.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416023&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:40:27.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768416026 status=200 resp_size=6392
|
||
2026-01-15 02:40:27.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416027&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 02:40:30.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768416030 status=200 resp_size=6718
|
||
2026-01-15 02:40:30.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416030&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 02:40:36.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768416036 status=200 resp_size=6049
|
||
2026-01-15 02:40:37.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416036&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:40:43.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768416042 status=200 resp_size=6511
|
||
2026-01-15 02:40:43.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416043&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 02:40:48.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768416047 status=200 resp_size=5940
|
||
2026-01-15 02:40:48.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416048&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:40:50.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768416050 status=200 resp_size=6573
|
||
2026-01-15 02:40:51.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416050&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 02:40:58.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768416057 status=200 resp_size=4058
|
||
2026-01-15 02:40:58.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416058&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 02:41:04.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768416063 status=200 resp_size=5232
|
||
2026-01-15 02:41:04.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416064&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:41:13.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768416072 status=200 resp_size=6177
|
||
2026-01-15 02:41:13.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416073&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 02:41:13.670 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:41:19.638 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:41:19.638 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 02:41:21.996 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.35 秒后继续...
|
||
2026-01-15 02:41:21.996 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 02:41:21.996 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:41:22.011 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:41:22.929 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:41:24.117 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:41:26.597 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:41:26.597 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:41:27.115 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416082 status=200 resp_size=132803
|
||
2026-01-15 02:41:27.115 | WARNING | __main__:get_recommend_jobs:745 - 第 5 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 02:41:27.115 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:41:27.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768416087 status=200 resp_size=6473
|
||
2026-01-15 02:41:27.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416087&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:41:29.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768416088 status=200 resp_size=5634
|
||
2026-01-15 02:41:29.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416089&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:41:37.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768416097 status=200 resp_size=6125
|
||
2026-01-15 02:41:37.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416097&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:41:40.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768416099 status=200 resp_size=5888
|
||
2026-01-15 02:41:40.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416100&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 02:41:48.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768416108 status=200 resp_size=6715
|
||
2026-01-15 02:41:48.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416108&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 02:41:55.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768416114 status=200 resp_size=6055
|
||
2026-01-15 02:41:55.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416115&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 02:41:58.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768416118 status=200 resp_size=5455
|
||
2026-01-15 02:41:58.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416118&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 02:42:01.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768416121 status=200 resp_size=7534
|
||
2026-01-15 02:42:01.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416121&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 02:42:06.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768416126 status=200 resp_size=6314
|
||
2026-01-15 02:42:06.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416126&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 02:42:10.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768416130 status=200 resp_size=5857
|
||
2026-01-15 02:42:10.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416130&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 02:42:20.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768416140 status=200 resp_size=6024
|
||
2026-01-15 02:42:20.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416140&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:42:22.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768416142 status=200 resp_size=5211
|
||
2026-01-15 02:42:22.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416142&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 02:42:32.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768416151 status=200 resp_size=5942
|
||
2026-01-15 02:42:32.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416152&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 02:42:39.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768416159 status=200 resp_size=8574
|
||
2026-01-15 02:42:39.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416159&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 02:42:46.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768416165 status=200 resp_size=5421
|
||
2026-01-15 02:42:46.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416166&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:42:53.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768416172 status=200 resp_size=7551
|
||
2026-01-15 02:42:53.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416173&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 02:42:55.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768416175 status=200 resp_size=5784
|
||
2026-01-15 02:42:56.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416175&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 02:43:02.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768416182 status=200 resp_size=5306
|
||
2026-01-15 02:43:03.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416182&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 02:43:05.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768416185 status=200 resp_size=5687
|
||
2026-01-15 02:43:05.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416185&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:43:05.852 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 02:43:11.694 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 02:43:11.694 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 02:43:18.607 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.91 秒后继续...
|
||
2026-01-15 02:43:18.607 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 02:43:18.607 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:43:18.632 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:43:19.275 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:43:20.423 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:43:22.575 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:43:22.575 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:43:23.062 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416198 status=200 resp_size=152402
|
||
2026-01-15 02:43:23.062 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:43:23.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768416203 status=200 resp_size=7182
|
||
2026-01-15 02:43:23.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416203&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 02:43:30.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768416209 status=200 resp_size=5407
|
||
2026-01-15 02:43:30.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416210&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 02:43:38.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768416218 status=200 resp_size=6343
|
||
2026-01-15 02:43:38.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416218&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 02:43:43.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768416223 status=200 resp_size=6958
|
||
2026-01-15 02:43:43.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416223&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:43:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768416226 status=200 resp_size=5655
|
||
2026-01-15 02:43:46.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416226&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 02:43:48.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768416228 status=200 resp_size=8225
|
||
2026-01-15 02:43:48.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416228&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 02:43:56.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768416236 status=200 resp_size=7119
|
||
2026-01-15 02:43:56.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416236&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 02:44:02.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768416241 status=200 resp_size=5497
|
||
2026-01-15 02:44:02.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416242&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:44:11.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768416251 status=200 resp_size=5615
|
||
2026-01-15 02:44:12.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416251&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 02:44:13.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768416253 status=200 resp_size=6714
|
||
2026-01-15 02:44:13.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416253&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 02:44:20.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768416259 status=200 resp_size=5775
|
||
2026-01-15 02:44:20.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416260&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 02:44:30.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768416270 status=200 resp_size=6689
|
||
2026-01-15 02:44:31.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416270&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:44:41.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768416280 status=200 resp_size=6696
|
||
2026-01-15 02:44:41.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416281&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 02:44:42.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768416282 status=200 resp_size=13102
|
||
2026-01-15 02:44:43.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416282&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 02:44:45.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768416285 status=200 resp_size=5128
|
||
2026-01-15 02:44:46.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416285&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 02:44:53.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768416293 status=200 resp_size=6390
|
||
2026-01-15 02:44:53.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416293&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:44:56.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768416296 status=200 resp_size=6362
|
||
2026-01-15 02:44:56.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416296&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 02:44:57.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768416297 status=200 resp_size=6529
|
||
2026-01-15 02:44:57.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416297&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 02:45:00.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768416300 status=200 resp_size=7130
|
||
2026-01-15 02:45:00.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416300&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 02:45:02.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768416302 status=200 resp_size=7126
|
||
2026-01-15 02:45:02.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416302&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:45:02.307 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:45:02.700 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:45:02.700 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 02:45:08.185 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.47 秒后继续...
|
||
2026-01-15 02:45:08.185 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 02:45:08.185 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:45:08.210 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:45:08.650 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:45:09.750 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:45:11.869 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:45:11.869 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:45:12.309 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416308 status=200 resp_size=139442
|
||
2026-01-15 02:45:12.309 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:45:12.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768416312 status=200 resp_size=7415
|
||
2026-01-15 02:45:12.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416312&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 02:45:19.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768416318 status=200 resp_size=5152
|
||
2026-01-15 02:45:19.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416319&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 02:45:23.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768416323 status=200 resp_size=5877
|
||
2026-01-15 02:45:24.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416323&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 02:45:28.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768416328 status=200 resp_size=6230
|
||
2026-01-15 02:45:28.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416328&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:45:38.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768416337 status=200 resp_size=6041
|
||
2026-01-15 02:45:38.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416338&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 02:45:40.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768416339 status=200 resp_size=5098
|
||
2026-01-15 02:45:40.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416340&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 02:45:46.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768416346 status=200 resp_size=5711
|
||
2026-01-15 02:45:47.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416346&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 02:45:50.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768416350 status=200 resp_size=8808
|
||
2026-01-15 02:45:50.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416350&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:45:58.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768416358 status=200 resp_size=6970
|
||
2026-01-15 02:45:59.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416358&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 02:46:02.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768416361 status=200 resp_size=5109
|
||
2026-01-15 02:46:02.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416362&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 02:46:06.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768416366 status=200 resp_size=7717
|
||
2026-01-15 02:46:06.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416366&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 02:46:16.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768416375 status=200 resp_size=5920
|
||
2026-01-15 02:46:16.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416376&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:46:26.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768416385 status=200 resp_size=8734
|
||
2026-01-15 02:46:26.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416386&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 02:46:28.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768416388 status=200 resp_size=5686
|
||
2026-01-15 02:46:28.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416388&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-15 02:46:30.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768416390 status=200 resp_size=4321
|
||
2026-01-15 02:46:30.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416390&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 02:46:36.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768416396 status=200 resp_size=6445
|
||
2026-01-15 02:46:37.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416396&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:46:47.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768416406 status=200 resp_size=5533
|
||
2026-01-15 02:46:47.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416407&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 02:46:55.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768416415 status=200 resp_size=5524
|
||
2026-01-15 02:46:55.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416415&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 02:47:02.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768416421 status=200 resp_size=6522
|
||
2026-01-15 02:47:02.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416422&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 02:47:06.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768416425 status=200 resp_size=6501
|
||
2026-01-15 02:47:06.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416426&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:47:06.301 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:47:12.473 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:47:12.473 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 02:47:21.141 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.66 秒后继续...
|
||
2026-01-15 02:47:21.141 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 02:47:21.141 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:47:21.160 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:47:21.631 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:47:22.746 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:47:24.851 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:47:24.851 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:47:25.339 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416441 status=200 resp_size=141677
|
||
2026-01-15 02:47:25.339 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:47:25.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768416445 status=200 resp_size=7756
|
||
2026-01-15 02:47:25.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416445&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 02:47:30.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768416450 status=200 resp_size=6318
|
||
2026-01-15 02:47:30.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416450&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 02:47:39.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768416458 status=200 resp_size=5458
|
||
2026-01-15 02:47:39.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416459&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 02:47:47.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768416466 status=200 resp_size=5678
|
||
2026-01-15 02:47:47.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416467&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:47:50.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768416469 status=200 resp_size=7237
|
||
2026-01-15 02:47:50.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416470&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 02:47:53.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768416473 status=200 resp_size=5342
|
||
2026-01-15 02:47:53.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416473&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 02:47:59.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768416479 status=200 resp_size=6431
|
||
2026-01-15 02:47:59.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416479&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 02:48:09.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768416489 status=200 resp_size=8457
|
||
2026-01-15 02:48:09.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416489&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:48:19.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768416498 status=200 resp_size=7607
|
||
2026-01-15 02:48:19.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416499&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 02:48:23.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768416503 status=200 resp_size=6416
|
||
2026-01-15 02:48:24.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416503&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 02:48:33.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768416512 status=200 resp_size=6168
|
||
2026-01-15 02:48:33.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416513&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:48:40.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768416520 status=200 resp_size=5876
|
||
2026-01-15 02:48:40.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416520&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 02:48:42.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768416522 status=200 resp_size=6646
|
||
2026-01-15 02:48:42.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416522&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 02:48:47.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768416527 status=200 resp_size=6511
|
||
2026-01-15 02:48:47.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416527&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:48:52.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768416532 status=200 resp_size=5477
|
||
2026-01-15 02:48:52.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416532&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 02:48:55.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768416535 status=200 resp_size=6449
|
||
2026-01-15 02:48:55.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416535&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 02:49:02.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768416541 status=200 resp_size=5925
|
||
2026-01-15 02:49:02.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416542&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 02:49:09.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768416549 status=200 resp_size=6119
|
||
2026-01-15 02:49:09.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416549&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:49:18.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768416557 status=200 resp_size=7750
|
||
2026-01-15 02:49:18.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416558&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 02:49:22.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768416562 status=200 resp_size=7971
|
||
2026-01-15 02:49:22.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416562&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 02:49:22.918 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:49:29.623 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:49:29.623 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 02:49:34.312 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.68 秒后继续...
|
||
2026-01-15 02:49:34.312 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 02:49:34.312 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:49:34.337 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:49:35.013 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:49:36.175 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:49:38.343 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:49:38.343 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:49:38.813 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416574 status=200 resp_size=159753
|
||
2026-01-15 02:49:38.813 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:49:39.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768416578 status=200 resp_size=8313
|
||
2026-01-15 02:49:39.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416579&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 02:49:47.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768416587 status=200 resp_size=6058
|
||
2026-01-15 02:49:48.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416587&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:49:50.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768416590 status=200 resp_size=5424
|
||
2026-01-15 02:49:50.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416590&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 02:49:58.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768416597 status=200 resp_size=8274
|
||
2026-01-15 02:49:58.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416598&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 02:50:02.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768416602 status=200 resp_size=8701
|
||
2026-01-15 02:50:02.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416602&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 02:50:06.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768416606 status=200 resp_size=6284
|
||
2026-01-15 02:50:06.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416606&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:50:08.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768416608 status=200 resp_size=5378
|
||
2026-01-15 02:50:08.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416608&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 02:50:13.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768416613 status=200 resp_size=7299
|
||
2026-01-15 02:50:13.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416613&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 02:50:17.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768416617 status=200 resp_size=7262
|
||
2026-01-15 02:50:17.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416617&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 02:50:24.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768416623 status=200 resp_size=6248
|
||
2026-01-15 02:50:24.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416624&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:50:29.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768416628 status=200 resp_size=7967
|
||
2026-01-15 02:50:29.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416629&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 02:50:37.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768416637 status=200 resp_size=5253
|
||
2026-01-15 02:50:37.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416637&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 02:50:46.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768416646 status=200 resp_size=5431
|
||
2026-01-15 02:50:47.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416646&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 02:50:56.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768416655 status=200 resp_size=4995
|
||
2026-01-15 02:50:56.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416656&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:51:06.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768416666 status=200 resp_size=6080
|
||
2026-01-15 02:51:07.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416666&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 02:51:13.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768416673 status=200 resp_size=5945
|
||
2026-01-15 02:51:14.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416673&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 02:51:19.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768416678 status=200 resp_size=4916
|
||
2026-01-15 02:51:19.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416679&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 02:51:21.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768416680 status=200 resp_size=5446
|
||
2026-01-15 02:51:21.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416681&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-15 02:51:28.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768416687 status=200 resp_size=6506
|
||
2026-01-15 02:51:28.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416688&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 02:51:36.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768416695 status=200 resp_size=5862
|
||
2026-01-15 02:51:36.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416696&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:51:36.443 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:51:42.975 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:51:42.975 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 02:51:47.774 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.80 秒后继续...
|
||
2026-01-15 02:51:47.774 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 02:51:47.774 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:51:47.798 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:51:48.440 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:51:49.572 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:51:51.724 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:51:51.724 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:51:52.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416707 status=200 resp_size=140761
|
||
2026-01-15 02:51:52.227 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:51:52.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768416712 status=200 resp_size=6226
|
||
2026-01-15 02:51:52.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416712&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 02:51:57.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768416717 status=200 resp_size=5613
|
||
2026-01-15 02:51:57.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416717&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 02:52:06.029 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768416725 status=200 resp_size=6422
|
||
2026-01-15 02:52:06.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416726&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 02:52:08.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768416728 status=200 resp_size=5792
|
||
2026-01-15 02:52:08.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416728&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:52:14.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768416734 status=200 resp_size=6176
|
||
2026-01-15 02:52:14.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416734&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 02:52:21.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768416740 status=200 resp_size=6731
|
||
2026-01-15 02:52:21.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416741&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 02:52:30.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768416750 status=200 resp_size=5575
|
||
2026-01-15 02:52:31.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416750&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 02:52:32.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768416752 status=200 resp_size=6856
|
||
2026-01-15 02:52:32.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416752&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 02:52:35.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768416755 status=200 resp_size=6768
|
||
2026-01-15 02:52:35.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416755&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:52:37.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768416757 status=200 resp_size=5731
|
||
2026-01-15 02:52:38.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416757&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 02:52:48.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768416766 status=200 resp_size=7075
|
||
2026-01-15 02:52:48.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416768&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 02:52:52.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768416772 status=200 resp_size=6530
|
||
2026-01-15 02:52:53.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416772&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:52:59.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768416778 status=200 resp_size=8973
|
||
2026-01-15 02:52:59.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416779&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 02:53:09.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768416789 status=200 resp_size=8559
|
||
2026-01-15 02:53:10.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416789&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 02:53:19.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768416799 status=200 resp_size=6688
|
||
2026-01-15 02:53:20.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416799&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 02:53:30.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768416809 status=200 resp_size=5290
|
||
2026-01-15 02:53:30.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416810&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 02:53:37.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768416816 status=200 resp_size=5982
|
||
2026-01-15 02:53:37.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416817&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 02:53:49.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768416827 status=200 resp_size=7919
|
||
2026-01-15 02:53:49.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416829&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 02:53:59.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768416838 status=200 resp_size=7681
|
||
2026-01-15 02:53:59.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416839&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 02:54:06.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768416846 status=200 resp_size=5278
|
||
2026-01-15 02:54:07.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416846&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 02:54:07.141 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:54:14.336 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:54:14.336 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 02:54:23.504 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.16 秒后继续...
|
||
2026-01-15 02:54:23.504 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 02:54:23.504 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:54:23.524 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:54:24.152 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:54:25.314 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:54:27.483 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:54:27.483 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:54:27.938 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416863 status=200 resp_size=132236
|
||
2026-01-15 02:54:27.938 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:54:28.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768416867 status=200 resp_size=5414
|
||
2026-01-15 02:54:28.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416868&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 02:54:32.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768416872 status=200 resp_size=6660
|
||
2026-01-15 02:54:32.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416872&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 02:54:34.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768416873 status=200 resp_size=7952
|
||
2026-01-15 02:54:34.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416874&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 02:54:39.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768416878 status=200 resp_size=5277
|
||
2026-01-15 02:54:39.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416879&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 02:54:48.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768416887 status=200 resp_size=7175
|
||
2026-01-15 02:54:48.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416888&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 02:54:52.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768416892 status=200 resp_size=6284
|
||
2026-01-15 02:54:53.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416892&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:54:59.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768416898 status=200 resp_size=5673
|
||
2026-01-15 02:54:59.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416899&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 02:55:02.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768416901 status=200 resp_size=5924
|
||
2026-01-15 02:55:03.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416902&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 02:55:07.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768416907 status=200 resp_size=6003
|
||
2026-01-15 02:55:07.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416907&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 02:55:12.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768416912 status=200 resp_size=5672
|
||
2026-01-15 02:55:12.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416912&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 02:55:14.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768416914 status=200 resp_size=5378
|
||
2026-01-15 02:55:14.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416914&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 02:55:24.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768416923 status=200 resp_size=5084
|
||
2026-01-15 02:55:24.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416924&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:55:26.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768416925 status=200 resp_size=4913
|
||
2026-01-15 02:55:26.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416926&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 02:55:34.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768416934 status=200 resp_size=9486
|
||
2026-01-15 02:55:34.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416934&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 02:55:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768416941 status=200 resp_size=5363
|
||
2026-01-15 02:55:48.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416946&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 02:55:50.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768416950 status=200 resp_size=13285
|
||
2026-01-15 02:55:51.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416950&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 02:55:59.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768416958 status=200 resp_size=6873
|
||
2026-01-15 02:55:59.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416959&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:56:06.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768416965 status=200 resp_size=6041
|
||
2026-01-15 02:56:06.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416966&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 02:56:14.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768416973 status=200 resp_size=6635
|
||
2026-01-15 02:56:14.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416974&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 02:56:16.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768416975 status=200 resp_size=5390
|
||
2026-01-15 02:56:16.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416976&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 02:56:16.401 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:56:22.824 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:56:22.824 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 02:56:32.063 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.23 秒后继续...
|
||
2026-01-15 02:56:32.063 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 02:56:32.063 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:56:32.090 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:56:32.703 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:56:33.833 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:56:35.969 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:56:35.969 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:56:36.440 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768416992 status=200 resp_size=124843
|
||
2026-01-15 02:56:36.440 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:56:36.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768416996 status=200 resp_size=8070
|
||
2026-01-15 02:56:36.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768416996&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 02:56:46.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768417006 status=200 resp_size=6588
|
||
2026-01-15 02:56:47.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417006&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 02:56:53.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768417012 status=200 resp_size=6300
|
||
2026-01-15 02:56:53.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417013&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 02:56:55.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768417014 status=200 resp_size=6073
|
||
2026-01-15 02:56:55.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417015&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:57:00.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768417020 status=200 resp_size=7194
|
||
2026-01-15 02:57:00.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417020&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 02:57:02.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768417021 status=200 resp_size=6053
|
||
2026-01-15 02:57:02.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417022&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 02:57:09.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768417029 status=200 resp_size=7170
|
||
2026-01-15 02:57:09.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417029&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 02:57:19.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768417039 status=200 resp_size=4572
|
||
2026-01-15 02:57:19.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417039&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 02:57:28.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768417047 status=200 resp_size=4992
|
||
2026-01-15 02:57:29.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417048&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 02:57:31.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768417050 status=200 resp_size=7194
|
||
2026-01-15 02:57:31.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417051&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 02:57:36.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768417055 status=200 resp_size=5356
|
||
2026-01-15 02:57:36.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417056&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 02:57:41.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768417061 status=200 resp_size=5554
|
||
2026-01-15 02:57:41.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417061&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:57:44.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768417064 status=200 resp_size=5280
|
||
2026-01-15 02:57:44.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417064&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 02:57:56.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768417074 status=200 resp_size=5040
|
||
2026-01-15 02:57:56.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417076&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 02:58:06.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768417085 status=200 resp_size=4993
|
||
2026-01-15 02:58:06.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417086&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 02:58:10.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768417090 status=200 resp_size=6752
|
||
2026-01-15 02:58:10.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417090&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:58:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768417099 status=200 resp_size=5887
|
||
2026-01-15 02:58:20.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417100&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 02:58:27.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768417106 status=200 resp_size=5764
|
||
2026-01-15 02:58:27.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417107&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 02:58:31.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768417111 status=200 resp_size=5688
|
||
2026-01-15 02:58:32.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417111&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 02:58:34.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768417113 status=200 resp_size=6980
|
||
2026-01-15 02:58:34.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417114&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 02:58:34.255 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 02:58:40.003 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 02:58:40.003 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 02:58:48.750 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.74 秒后继续...
|
||
2026-01-15 02:58:48.750 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 02:58:48.750 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 02:58:48.780 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 02:58:49.284 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:58:50.399 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:58:52.535 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 02:58:52.535 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 02:58:52.975 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417128 status=200 resp_size=144475
|
||
2026-01-15 02:58:52.975 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 02:58:53.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768417132 status=200 resp_size=5283
|
||
2026-01-15 02:58:53.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417133&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 02:58:56.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768417136 status=200 resp_size=5215
|
||
2026-01-15 02:58:56.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417136&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 02:58:58.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768417138 status=200 resp_size=5501
|
||
2026-01-15 02:58:58.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417138&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 02:59:07.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768417146 status=200 resp_size=6659
|
||
2026-01-15 02:59:07.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417147&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 02:59:17.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768417153 status=200 resp_size=5165
|
||
2026-01-15 02:59:17.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417157&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 02:59:20.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768417160 status=200 resp_size=5570
|
||
2026-01-15 02:59:20.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417160&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 02:59:27.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768417166 status=200 resp_size=9108
|
||
2026-01-15 02:59:27.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417167&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 02:59:33.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768417173 status=200 resp_size=5688
|
||
2026-01-15 02:59:34.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417173&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 02:59:36.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768417176 status=200 resp_size=6380
|
||
2026-01-15 02:59:36.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417176&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 02:59:41.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768417181 status=200 resp_size=6612
|
||
2026-01-15 02:59:41.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417181&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 02:59:54.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768417187 status=200 resp_size=7975
|
||
2026-01-15 03:00:01.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417194&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 03:00:08.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768417207 status=200 resp_size=5984
|
||
2026-01-15 03:00:08.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417208&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 03:00:16.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768417215 status=200 resp_size=7270
|
||
2026-01-15 03:00:16.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417216&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 03:00:23.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768417222 status=200 resp_size=5580
|
||
2026-01-15 03:00:23.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417223&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 03:00:30.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768417230 status=200 resp_size=6935
|
||
2026-01-15 03:00:30.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417230&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 03:00:41.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768417240 status=200 resp_size=5924
|
||
2026-01-15 03:00:41.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417241&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 03:00:50.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768417249 status=200 resp_size=6027
|
||
2026-01-15 03:00:50.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417250&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 03:00:54.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768417254 status=200 resp_size=6028
|
||
2026-01-15 03:00:54.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417254&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 03:00:59.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768417259 status=200 resp_size=6111
|
||
2026-01-15 03:00:59.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417259&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 03:01:09.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768417269 status=200 resp_size=8782
|
||
2026-01-15 03:01:09.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417269&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 03:01:09.973 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:01:10.303 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:01:10.303 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 03:01:19.274 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.97 秒后继续...
|
||
2026-01-15 03:01:19.274 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 03:01:19.274 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:01:19.303 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:01:19.838 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:01:20.954 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:01:23.075 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:01:23.075 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:01:23.514 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417279 status=200 resp_size=146271
|
||
2026-01-15 03:01:23.514 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:01:23.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768417283 status=200 resp_size=8655
|
||
2026-01-15 03:01:23.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417283&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 03:01:33.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768417293 status=200 resp_size=6440
|
||
2026-01-15 03:01:34.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417293&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 03:01:35.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768417295 status=200 resp_size=7907
|
||
2026-01-15 03:01:35.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417295&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 03:01:40.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768417300 status=200 resp_size=4592
|
||
2026-01-15 03:01:40.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417300&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 03:02:22.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768417307 status=200 resp_size=5878
|
||
2026-01-15 03:02:31.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417342&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 03:02:38.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768417354 status=200 resp_size=6437
|
||
2026-01-15 03:02:43.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417358&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 03:02:50.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768417369 status=200 resp_size=7313
|
||
2026-01-15 03:02:50.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417370&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 03:02:55.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768417375 status=200 resp_size=6958
|
||
2026-01-15 03:02:55.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417375&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 03:02:57.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768417376 status=200 resp_size=6694
|
||
2026-01-15 03:02:57.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417377&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 03:03:07.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768417387 status=200 resp_size=6568
|
||
2026-01-15 03:03:07.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417387&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 03:03:23.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768417394 status=200 resp_size=5922
|
||
2026-01-15 03:03:28.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417403&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 03:03:35.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768417414 status=200 resp_size=5499
|
||
2026-01-15 03:03:35.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417415&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 03:03:45.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768417424 status=200 resp_size=6184
|
||
2026-01-15 03:03:45.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417425&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 03:03:49.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768417429 status=200 resp_size=5673
|
||
2026-01-15 03:03:50.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417429&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 03:03:53.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768417433 status=200 resp_size=7081
|
||
2026-01-15 03:03:53.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417433&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 03:03:55.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768417435 status=200 resp_size=7664
|
||
2026-01-15 03:03:56.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417435&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 03:04:07.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768417441 status=200 resp_size=6652
|
||
2026-01-15 03:04:09.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417447&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 03:04:16.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768417455 status=200 resp_size=4733
|
||
2026-01-15 03:04:16.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417456&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:04:19.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768417458 status=200 resp_size=4926
|
||
2026-01-15 03:04:19.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417459&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 03:04:27.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768417467 status=200 resp_size=4906
|
||
2026-01-15 03:04:27.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417467&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 03:04:27.992 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:04:28.322 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:04:28.322 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 03:04:29.410 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.08 秒后继续...
|
||
2026-01-15 03:04:29.410 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 03:04:29.410 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:04:29.421 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:04:30.096 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:04:31.258 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:04:33.409 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:04:33.409 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:04:33.943 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417469 status=200 resp_size=137298
|
||
2026-01-15 03:04:33.943 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:04:34.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768417473 status=200 resp_size=7369
|
||
2026-01-15 03:04:34.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417474&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 03:04:35.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768417475 status=200 resp_size=4834
|
||
2026-01-15 03:04:36.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417475&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:04:37.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768417477 status=200 resp_size=5006
|
||
2026-01-15 03:04:38.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417477&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 03:04:47.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768417486 status=200 resp_size=5363
|
||
2026-01-15 03:04:47.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417487&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 03:04:50.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768417489 status=200 resp_size=5232
|
||
2026-01-15 03:04:50.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417490&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 03:04:57.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768417497 status=200 resp_size=6946
|
||
2026-01-15 03:04:57.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417497&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 03:05:04.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768417504 status=200 resp_size=4956
|
||
2026-01-15 03:05:05.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417504&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:05:14.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768417514 status=200 resp_size=7382
|
||
2026-01-15 03:05:14.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417514&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 03:05:18.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768417518 status=200 resp_size=7331
|
||
2026-01-15 03:05:18.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417518&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 03:05:26.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768417525 status=200 resp_size=5087
|
||
2026-01-15 03:05:26.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417526&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 03:05:36.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768417535 status=200 resp_size=6551
|
||
2026-01-15 03:05:36.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417536&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 03:05:46.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768417545 status=200 resp_size=4515
|
||
2026-01-15 03:05:46.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417546&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 03:05:48.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768417548 status=200 resp_size=4865
|
||
2026-01-15 03:05:49.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417548&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 03:05:54.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768417554 status=200 resp_size=5241
|
||
2026-01-15 03:05:55.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417554&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 03:06:05.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768417564 status=200 resp_size=5494
|
||
2026-01-15 03:06:05.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417565&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 03:06:07.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768417567 status=200 resp_size=6572
|
||
2026-01-15 03:06:07.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417567&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 03:06:15.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768417574 status=200 resp_size=5674
|
||
2026-01-15 03:06:15.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417575&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 03:06:25.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768417584 status=200 resp_size=6137
|
||
2026-01-15 03:06:25.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417585&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 03:06:35.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768417594 status=200 resp_size=6303
|
||
2026-01-15 03:06:35.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417595&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 03:06:38.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768417598 status=200 resp_size=5471
|
||
2026-01-15 03:06:39.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417598&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 03:06:39.007 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:06:44.835 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:06:44.835 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 03:06:52.992 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.15 秒后继续...
|
||
2026-01-15 03:06:52.992 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 03:06:52.992 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:06:53.021 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:06:53.569 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:06:54.685 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:06:56.820 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:06:56.820 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:06:57.339 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417613 status=200 resp_size=135665
|
||
2026-01-15 03:06:57.339 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:06:57.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768417617 status=200 resp_size=5725
|
||
2026-01-15 03:06:57.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417617&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 03:07:03.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768417623 status=200 resp_size=4737
|
||
2026-01-15 03:07:03.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417623&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 03:07:14.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768417630 status=200 resp_size=4297
|
||
2026-01-15 03:07:15.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417634&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 03:07:18.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768417637 status=200 resp_size=6856
|
||
2026-01-15 03:07:19.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417638&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 03:07:24.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768417643 status=200 resp_size=5259
|
||
2026-01-15 03:07:26.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417644&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 03:07:30.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job×tamp=1768417649 status=200 resp_size=4786
|
||
2026-01-15 03:07:31.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417650&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 03:07:45.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768417658 status=200 resp_size=5746
|
||
2026-01-15 03:07:47.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417665&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 03:07:55.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768417674 status=200 resp_size=5466
|
||
2026-01-15 03:07:55.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417675&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 03:07:57.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768417677 status=200 resp_size=5037
|
||
2026-01-15 03:07:57.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417677&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 03:08:02.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768417682 status=200 resp_size=5631
|
||
2026-01-15 03:08:02.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417682&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 03:08:12.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768417691 status=200 resp_size=5979
|
||
2026-01-15 03:08:12.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417692&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 03:08:19.668 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768417699 status=200 resp_size=6264
|
||
2026-01-15 03:08:19.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417699&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 03:08:29.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768417708 status=200 resp_size=5973
|
||
2026-01-15 03:08:29.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417709&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 03:08:35.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768417714 status=200 resp_size=5928
|
||
2026-01-15 03:08:35.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417715&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 03:08:41.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768417720 status=200 resp_size=6295
|
||
2026-01-15 03:08:41.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417721&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 03:08:49.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768417729 status=200 resp_size=5806
|
||
2026-01-15 03:08:50.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417729&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 03:09:00.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768417739 status=200 resp_size=5174
|
||
2026-01-15 03:09:00.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417740&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 03:09:10.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768417749 status=200 resp_size=6666
|
||
2026-01-15 03:09:10.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417750&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 03:09:17.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768417757 status=200 resp_size=4654
|
||
2026-01-15 03:09:17.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417757&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 03:09:20.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768417760 status=200 resp_size=7057
|
||
2026-01-15 03:09:20.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417760&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 03:09:20.976 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:09:26.891 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:09:26.891 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 03:09:33.076 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.18 秒后继续...
|
||
2026-01-15 03:09:33.076 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 03:09:33.076 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:09:33.101 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:09:33.603 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:09:34.734 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:09:36.838 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:09:36.838 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:09:37.262 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417773 status=200 resp_size=117987
|
||
2026-01-15 03:09:37.262 | WARNING | __main__:get_recommend_jobs:745 - 第 17 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 03:09:37.262 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:09:37.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768417777 status=200 resp_size=7248
|
||
2026-01-15 03:09:37.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417777&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 03:09:45.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768417785 status=200 resp_size=6546
|
||
2026-01-15 03:09:45.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417785&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 03:09:55.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768417794 status=200 resp_size=6546
|
||
2026-01-15 03:09:55.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417795&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 03:09:57.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job×tamp=1768417797 status=200 resp_size=4679
|
||
2026-01-15 03:09:57.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417797&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
|
||
2026-01-15 03:10:04.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768417803 status=200 resp_size=4783
|
||
2026-01-15 03:10:04.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417804&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 03:10:08.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768417807 status=200 resp_size=5359
|
||
2026-01-15 03:10:08.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417808&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:10:13.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768417813 status=200 resp_size=6326
|
||
2026-01-15 03:10:13.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417813&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 03:10:21.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768417820 status=200 resp_size=5106
|
||
2026-01-15 03:10:21.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417821&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 03:10:31.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768417830 status=200 resp_size=5306
|
||
2026-01-15 03:10:31.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417831&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 03:10:35.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768417835 status=200 resp_size=6073
|
||
2026-01-15 03:10:35.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417835&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 03:10:43.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768417842 status=200 resp_size=6325
|
||
2026-01-15 03:10:43.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417843&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 03:10:53.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768417853 status=200 resp_size=5111
|
||
2026-01-15 03:10:53.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417853&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 03:10:57.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768417857 status=200 resp_size=5915
|
||
2026-01-15 03:10:58.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417857&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 03:11:02.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768417862 status=200 resp_size=5282
|
||
2026-01-15 03:11:03.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417862&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 03:11:12.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job×tamp=1768417871 status=200 resp_size=7722
|
||
2026-01-15 03:11:12.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417872&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 03:11:18.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768417877 status=200 resp_size=4719
|
||
2026-01-15 03:11:18.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417878&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 03:11:20.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768417880 status=200 resp_size=5294
|
||
2026-01-15 03:11:20.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417880&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:11:26.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768417885 status=200 resp_size=7688
|
||
2026-01-15 03:11:26.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417886&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 03:11:53.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768417894 status=200 resp_size=5943
|
||
2026-01-15 03:11:56.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417913&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 03:11:56.539 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 03:11:56.821 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 03:11:56.837 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 03:12:01.405 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.57 秒后继续...
|
||
2026-01-15 03:12:01.405 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 03:12:01.407 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:12:01.422 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:12:02.020 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:12:03.150 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:12:05.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:12:05.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:12:05.742 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768417921 status=200 resp_size=135473
|
||
2026-01-15 03:12:05.757 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:12:05.962 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768417925 status=200 resp_size=4757
|
||
2026-01-15 03:12:06.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417925&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 03:12:08.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768417928 status=200 resp_size=5693
|
||
2026-01-15 03:12:08.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417928&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:12:26.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768417933 status=200 resp_size=5853
|
||
2026-01-15 03:12:28.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417946&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 03:12:35.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768417952 status=200 resp_size=5360
|
||
2026-01-15 03:12:36.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417955&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 03:12:43.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768417961 status=200 resp_size=5666
|
||
2026-01-15 03:12:45.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417963&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 03:12:50.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768417970 status=200 resp_size=5591
|
||
2026-01-15 03:12:52.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417970&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:13:02.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768417982 status=200 resp_size=5651
|
||
2026-01-15 03:13:03.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417982&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 03:13:10.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job×tamp=1768417989 status=200 resp_size=4864
|
||
2026-01-15 03:13:10.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417990&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:13:16.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768417995 status=200 resp_size=4333
|
||
2026-01-15 03:13:16.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417996&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 03:13:19.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768417999 status=200 resp_size=5317
|
||
2026-01-15 03:13:19.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768417999&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:13:22.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768418002 status=200 resp_size=6269
|
||
2026-01-15 03:13:23.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418002&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 03:13:32.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768418011 status=200 resp_size=5151
|
||
2026-01-15 03:13:32.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418012&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:13:34.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768418013 status=200 resp_size=5481
|
||
2026-01-15 03:13:34.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418014&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 03:13:44.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768418024 status=200 resp_size=5510
|
||
2026-01-15 03:13:45.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418024&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:13:48.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768418028 status=200 resp_size=6454
|
||
2026-01-15 03:13:48.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418028&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:13:57.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768418037 status=200 resp_size=8675
|
||
2026-01-15 03:13:58.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418037&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 03:14:02.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768418042 status=200 resp_size=5938
|
||
2026-01-15 03:14:02.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418042&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 03:14:07.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768418047 status=200 resp_size=8440
|
||
2026-01-15 03:14:07.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418047&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 03:14:16.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768418056 status=200 resp_size=6458
|
||
2026-01-15 03:14:16.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418056&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:14:28.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768418066 status=200 resp_size=5227
|
||
2026-01-15 03:14:30.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418068&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 03:14:30.115 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:14:36.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:14:36.035 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 03:14:38.548 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.50 秒后继续...
|
||
2026-01-15 03:14:38.548 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 03:14:38.548 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:14:38.562 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:14:39.096 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:14:40.227 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:14:42.346 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:14:42.346 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:14:42.786 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418078 status=200 resp_size=110526
|
||
2026-01-15 03:14:42.786 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:14:42.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768418082 status=200 resp_size=5162
|
||
2026-01-15 03:14:43.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418082&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 03:14:54.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768418088 status=200 resp_size=6414
|
||
2026-01-15 03:14:55.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418094&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 03:15:01.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768418100 status=200 resp_size=6062
|
||
2026-01-15 03:15:02.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418101&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 03:15:13.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768418111 status=200 resp_size=5449
|
||
2026-01-15 03:15:14.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418113&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 03:15:21.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768418119 status=200 resp_size=5708
|
||
2026-01-15 03:15:22.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418121&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 03:15:29.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768418128 status=200 resp_size=6976
|
||
2026-01-15 03:15:29.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418129&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 03:15:37.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768418137 status=200 resp_size=5837
|
||
2026-01-15 03:15:38.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418137&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 03:15:46.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768418146 status=200 resp_size=5506
|
||
2026-01-15 03:15:47.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418146&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 03:15:49.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768418149 status=200 resp_size=5845
|
||
2026-01-15 03:15:49.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418149&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 03:16:00.148 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 515 Target Unavailable
|
||
2026-01-15 03:16:01.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768418155 status=200 resp_size=6139
|
||
2026-01-15 03:16:01.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418161&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 03:16:05.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768418165 status=200 resp_size=5599
|
||
2026-01-15 03:16:06.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418165&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 03:16:10.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768418170 status=200 resp_size=5636
|
||
2026-01-15 03:16:10.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418170&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 03:16:11.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768418171 status=200 resp_size=6222
|
||
2026-01-15 03:16:11.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418171&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 03:16:19.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768418178 status=200 resp_size=7704
|
||
2026-01-15 03:16:19.453 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418179&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 03:16:26.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768418186 status=200 resp_size=5400
|
||
2026-01-15 03:16:26.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418186&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 03:16:33.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768418192 status=200 resp_size=5846
|
||
2026-01-15 03:16:33.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418193&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 03:16:39.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768418198 status=200 resp_size=4627
|
||
2026-01-15 03:16:39.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418199&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 03:17:12.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768418205 status=200 resp_size=6090
|
||
2026-01-15 03:17:20.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418232&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:17:30.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768418250 status=200 resp_size=6341
|
||
2026-01-15 03:17:30.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418250&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 03:17:33.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768418253 status=200 resp_size=6896
|
||
2026-01-15 03:17:34.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418253&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 03:17:34.034 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:17:39.467 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:17:39.467 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 03:17:41.007 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.53 秒后继续...
|
||
2026-01-15 03:17:41.007 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 03:17:41.007 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:17:41.037 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:17:41.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:17:42.874 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:17:45.027 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:17:45.027 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:17:45.498 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418261 status=200 resp_size=107884
|
||
2026-01-15 03:17:45.498 | WARNING | __main__:get_recommend_jobs:745 - 第 20 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 03:17:45.498 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:17:45.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768418265 status=200 resp_size=5290
|
||
2026-01-15 03:17:45.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418265&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 03:17:47.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768418267 status=200 resp_size=5976
|
||
2026-01-15 03:17:48.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418267&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:17:58.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768418277 status=200 resp_size=6435
|
||
2026-01-15 03:17:58.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418278&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 03:18:00.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768418279 status=200 resp_size=6490
|
||
2026-01-15 03:18:00.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418280&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 03:18:02.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768418282 status=200 resp_size=6194
|
||
2026-01-15 03:18:02.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418282&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 03:18:07.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768418287 status=200 resp_size=6078
|
||
2026-01-15 03:18:07.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418287&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:18:17.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768418296 status=200 resp_size=5526
|
||
2026-01-15 03:18:17.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418297&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 03:18:19.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768418299 status=200 resp_size=6819
|
||
2026-01-15 03:18:19.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418299&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 03:18:28.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768418308 status=200 resp_size=5830
|
||
2026-01-15 03:18:29.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418308&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 03:18:37.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768418316 status=200 resp_size=4786
|
||
2026-01-15 03:18:37.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418317&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:18:44.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768418324 status=200 resp_size=6984
|
||
2026-01-15 03:18:44.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418324&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 03:18:47.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768418327 status=200 resp_size=5443
|
||
2026-01-15 03:18:47.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418327&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 03:18:56.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768418336 status=200 resp_size=6066
|
||
2026-01-15 03:18:57.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418336&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 03:18:58.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768418338 status=200 resp_size=5541
|
||
2026-01-15 03:18:59.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418338&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 03:19:02.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768418342 status=200 resp_size=6058
|
||
2026-01-15 03:19:03.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418343&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 03:19:07.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768418347 status=200 resp_size=5879
|
||
2026-01-15 03:19:07.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418347&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 03:19:24.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768418356 status=200 resp_size=5379
|
||
2026-01-15 03:19:26.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418364&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 03:19:32.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768418371 status=200 resp_size=5655
|
||
2026-01-15 03:19:34.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418372&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 03:19:40.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768418378 status=200 resp_size=6286
|
||
2026-01-15 03:19:41.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418380&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 03:19:41.741 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 03:19:42.070 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 03:19:42.070 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 03:19:47.318 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.24 秒后继续...
|
||
2026-01-15 03:19:47.318 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 03:19:47.318 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:19:47.334 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:19:47.867 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:19:49.008 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:19:51.135 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:19:51.135 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:19:51.559 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418387 status=200 resp_size=116157
|
||
2026-01-15 03:19:51.559 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:19:51.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768418391 status=200 resp_size=5496
|
||
2026-01-15 03:19:51.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418391&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 03:20:03.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768418401 status=200 resp_size=6106
|
||
2026-01-15 03:20:05.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418403&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 03:20:08.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768418407 status=200 resp_size=6326
|
||
2026-01-15 03:20:08.991 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418408&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 03:20:13.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768418412 status=200 resp_size=5398
|
||
2026-01-15 03:20:15.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418413&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 03:20:37.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768418424 status=200 resp_size=5294
|
||
2026-01-15 03:20:39.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418437&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:20:43.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768418441 status=200 resp_size=5984
|
||
2026-01-15 03:20:48.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418443&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 03:20:54.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768418451 status=200 resp_size=5662
|
||
2026-01-15 03:20:56.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418454&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 03:21:27.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768418465 status=200 resp_size=5835
|
||
2026-01-15 03:21:29.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418487&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 03:21:36.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768418493 status=200 resp_size=6131
|
||
2026-01-15 03:21:38.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418496&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 03:21:46.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768418505 status=200 resp_size=6108
|
||
2026-01-15 03:21:46.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418506&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:21:51.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768418510 status=200 resp_size=5951
|
||
2026-01-15 03:21:51.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418511&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 03:21:58.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768418518 status=200 resp_size=6219
|
||
2026-01-15 03:21:59.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418518&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 03:22:01.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768418521 status=200 resp_size=6039
|
||
2026-01-15 03:22:02.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418521&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 03:22:03.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768418523 status=200 resp_size=5675
|
||
2026-01-15 03:22:03.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418523&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:22:11.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768418530 status=200 resp_size=5849
|
||
2026-01-15 03:22:11.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418531&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 03:22:18.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768418537 status=200 resp_size=5335
|
||
2026-01-15 03:22:18.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418538&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:22:26.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768418545 status=200 resp_size=6351
|
||
2026-01-15 03:22:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418546&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 03:22:31.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768418551 status=200 resp_size=6113
|
||
2026-01-15 03:22:31.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418551&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:22:41.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768418561 status=200 resp_size=5829
|
||
2026-01-15 03:22:41.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418561&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 03:22:48.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768418567 status=200 resp_size=6338
|
||
2026-01-15 03:22:48.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418568&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:22:48.354 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:22:53.946 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:22:53.946 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 03:23:01.875 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.93 秒后继续...
|
||
2026-01-15 03:23:01.875 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 03:23:01.875 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:23:01.910 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:23:02.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:23:03.528 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:23:05.648 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:23:05.648 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:23:06.057 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418581 status=200 resp_size=140737
|
||
2026-01-15 03:23:06.057 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:23:06.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768418586 status=200 resp_size=5107
|
||
2026-01-15 03:23:06.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418586&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 03:23:07.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768418587 status=200 resp_size=6385
|
||
2026-01-15 03:23:07.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418587&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:23:11.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768418591 status=200 resp_size=5106
|
||
2026-01-15 03:23:11.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418591&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 03:23:19.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768418599 status=200 resp_size=6535
|
||
2026-01-15 03:23:19.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418599&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:23:22.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768418602 status=200 resp_size=4774
|
||
2026-01-15 03:23:23.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418602&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 03:23:26.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768418606 status=200 resp_size=6963
|
||
2026-01-15 03:23:26.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418606&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:23:31.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768418611 status=200 resp_size=5463
|
||
2026-01-15 03:23:31.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418611&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 03:23:38.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768418618 status=200 resp_size=5490
|
||
2026-01-15 03:23:38.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418618&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:23:46.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768418625 status=200 resp_size=5448
|
||
2026-01-15 03:23:46.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418626&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 03:23:57.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768418636 status=200 resp_size=7079
|
||
2026-01-15 03:23:57.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418637&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 03:24:05.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768418644 status=200 resp_size=6053
|
||
2026-01-15 03:24:05.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418645&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 03:24:09.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768418649 status=200 resp_size=6091
|
||
2026-01-15 03:24:09.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418649&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:24:18.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768418657 status=200 resp_size=5197
|
||
2026-01-15 03:24:18.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418658&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:24:20.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768418660 status=200 resp_size=7337
|
||
2026-01-15 03:24:21.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418660&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 03:24:27.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768418666 status=200 resp_size=6216
|
||
2026-01-15 03:24:27.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418667&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 03:24:36.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768418676 status=200 resp_size=5503
|
||
2026-01-15 03:24:36.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418676&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:24:44.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768418683 status=200 resp_size=5703
|
||
2026-01-15 03:24:44.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418684&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:24:53.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768418692 status=200 resp_size=5924
|
||
2026-01-15 03:24:53.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418693&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 03:24:55.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768418694 status=200 resp_size=6271
|
||
2026-01-15 03:24:55.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418695&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 03:25:00.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768418699 status=200 resp_size=5236
|
||
2026-01-15 03:25:00.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418700&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:25:00.247 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:25:06.275 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:25:06.278 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 03:25:15.117 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.84 秒后继续...
|
||
2026-01-15 03:25:15.117 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 03:25:15.117 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:25:15.132 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:25:15.709 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:25:16.844 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:25:18.995 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:25:18.995 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:25:19.421 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418715 status=200 resp_size=136557
|
||
2026-01-15 03:25:19.421 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:25:19.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768418719 status=200 resp_size=4841
|
||
2026-01-15 03:25:19.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418719&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:25:29.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768418728 status=200 resp_size=6316
|
||
2026-01-15 03:25:29.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418729&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 03:25:31.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job×tamp=1768418731 status=200 resp_size=6215
|
||
2026-01-15 03:25:31.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418731&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
|
||
2026-01-15 03:25:38.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768418737 status=200 resp_size=5338
|
||
2026-01-15 03:25:38.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418738&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:25:42.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768418742 status=200 resp_size=5112
|
||
2026-01-15 03:25:42.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418742&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:25:49.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768418748 status=200 resp_size=6150
|
||
2026-01-15 03:25:49.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418749&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 03:25:59.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768418758 status=200 resp_size=5205
|
||
2026-01-15 03:26:00.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418759&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:26:08.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768418768 status=200 resp_size=5166
|
||
2026-01-15 03:26:08.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418768&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:26:13.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768418773 status=200 resp_size=5390
|
||
2026-01-15 03:26:13.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418773&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:26:22.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768418781 status=200 resp_size=5148
|
||
2026-01-15 03:26:22.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418782&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:26:23.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768418783 status=200 resp_size=4870
|
||
2026-01-15 03:26:24.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418784&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:26:34.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768418794 status=200 resp_size=5055
|
||
2026-01-15 03:26:34.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418794&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:26:38.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768418798 status=200 resp_size=4979
|
||
2026-01-15 03:26:38.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418798&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:26:48.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768418807 status=200 resp_size=4847
|
||
2026-01-15 03:26:48.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418808&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:26:53.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768418813 status=200 resp_size=5426
|
||
2026-01-15 03:26:53.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418813&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:26:56.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768418816 status=200 resp_size=5600
|
||
2026-01-15 03:26:57.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418816&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:27:04.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768418824 status=200 resp_size=5587
|
||
2026-01-15 03:27:04.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418824&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:27:11.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768418830 status=200 resp_size=5032
|
||
2026-01-15 03:27:11.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418831&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:27:21.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768418840 status=200 resp_size=5461
|
||
2026-01-15 03:27:21.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418841&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:27:25.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768418845 status=200 resp_size=5182
|
||
2026-01-15 03:27:25.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418845&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:27:25.378 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:27:31.455 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:27:31.455 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 03:27:35.405 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.94 秒后继续...
|
||
2026-01-15 03:27:35.405 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 03:27:35.405 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:27:35.430 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:27:36.059 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:27:37.206 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:27:39.357 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:27:39.357 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:27:39.843 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418855 status=200 resp_size=129871
|
||
2026-01-15 03:27:39.843 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:27:40.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768418859 status=200 resp_size=5200
|
||
2026-01-15 03:27:40.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418860&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:27:49.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768418868 status=200 resp_size=5552
|
||
2026-01-15 03:27:49.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418869&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:27:55.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768418875 status=200 resp_size=5224
|
||
2026-01-15 03:27:55.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418875&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:27:57.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768418877 status=200 resp_size=5489
|
||
2026-01-15 03:27:57.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418877&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:28:03.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768418882 status=200 resp_size=5190
|
||
2026-01-15 03:28:03.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418883&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:28:08.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768418888 status=200 resp_size=5295
|
||
2026-01-15 03:28:08.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418888&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:28:12.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768418891 status=200 resp_size=4383
|
||
2026-01-15 03:28:12.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418892&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 03:28:16.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768418896 status=200 resp_size=10632
|
||
2026-01-15 03:28:16.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418896&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 03:28:19.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768418898 status=200 resp_size=4990
|
||
2026-01-15 03:28:19.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418899&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 03:28:23.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768418902 status=200 resp_size=4985
|
||
2026-01-15 03:28:23.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418903&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:28:26.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768418906 status=200 resp_size=5236
|
||
2026-01-15 03:28:26.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418906&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 03:28:29.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768418908 status=200 resp_size=4315
|
||
2026-01-15 03:28:29.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418909&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 03:28:33.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768418913 status=200 resp_size=7628
|
||
2026-01-15 03:28:33.675 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418913&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 03:28:43.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768418923 status=200 resp_size=4972
|
||
2026-01-15 03:28:43.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418923&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:28:53.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768418933 status=200 resp_size=6205
|
||
2026-01-15 03:28:53.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418933&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 03:28:58.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job×tamp=1768418937 status=200 resp_size=4425
|
||
2026-01-15 03:28:58.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418938&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 03:29:00.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768418940 status=200 resp_size=6095
|
||
2026-01-15 03:29:01.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418940&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:29:09.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768418949 status=200 resp_size=5158
|
||
2026-01-15 03:29:09.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418949&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:29:11.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768418951 status=200 resp_size=5147
|
||
2026-01-15 03:29:11.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418951&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 03:29:15.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768418955 status=200 resp_size=6401
|
||
2026-01-15 03:29:15.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418955&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:29:15.795 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:29:21.683 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:29:21.683 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 03:29:28.899 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.21 秒后继续...
|
||
2026-01-15 03:29:28.899 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 03:29:28.899 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:29:28.920 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:29:29.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:29:30.536 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:29:32.658 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:29:32.658 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:29:33.084 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768418968 status=200 resp_size=135870
|
||
2026-01-15 03:29:33.084 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:29:33.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768418973 status=200 resp_size=6101
|
||
2026-01-15 03:29:33.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418973&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:29:42.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768418982 status=200 resp_size=4978
|
||
2026-01-15 03:29:43.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418982&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:29:44.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768418984 status=200 resp_size=4991
|
||
2026-01-15 03:29:44.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418984&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 03:29:47.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768418986 status=200 resp_size=6793
|
||
2026-01-15 03:29:47.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418987&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:29:51.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768418991 status=200 resp_size=6117
|
||
2026-01-15 03:29:51.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768418991&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:30:02.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768419001 status=200 resp_size=5026
|
||
2026-01-15 03:30:02.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:30:07.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768419007 status=200 resp_size=5128
|
||
2026-01-15 03:30:08.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419007&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:30:09.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job×tamp=1768419009 status=200 resp_size=5325
|
||
2026-01-15 03:30:10.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419009&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
|
||
2026-01-15 03:30:11.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768419011 status=200 resp_size=6108
|
||
2026-01-15 03:30:11.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419011&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:30:21.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768419021 status=200 resp_size=4859
|
||
2026-01-15 03:30:21.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419021&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:30:25.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768419025 status=200 resp_size=4835
|
||
2026-01-15 03:30:25.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419025&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 03:30:27.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768419027 status=200 resp_size=7131
|
||
2026-01-15 03:30:27.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419027&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 03:30:30.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768419030 status=200 resp_size=6109
|
||
2026-01-15 03:30:30.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419030&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:30:39.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768419039 status=200 resp_size=5992
|
||
2026-01-15 03:30:39.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419039&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 03:30:41.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768419041 status=200 resp_size=6770
|
||
2026-01-15 03:30:41.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419041&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 03:30:45.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768419045 status=200 resp_size=6749
|
||
2026-01-15 03:30:45.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419045&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 03:30:54.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768419053 status=200 resp_size=6115
|
||
2026-01-15 03:30:54.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419054&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:30:58.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768419058 status=200 resp_size=6794
|
||
2026-01-15 03:30:58.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419058&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 03:31:02.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768419062 status=200 resp_size=6044
|
||
2026-01-15 03:31:02.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419062&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:31:03.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768419063 status=200 resp_size=6544
|
||
2026-01-15 03:31:04.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419063&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 03:31:04.112 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:31:10.189 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:31:10.189 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 03:31:18.428 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.24 秒后继续...
|
||
2026-01-15 03:31:18.428 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 03:31:18.428 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:31:18.453 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=常德, 工作类型=3812
|
||
2026-01-15 03:31:18.923 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:31:20.038 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:31:22.160 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:31:22.160 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:31:22.600 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419078 status=200 resp_size=115115
|
||
2026-01-15 03:31:22.600 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17) | API返回totalCount: 517 (原始值: 517) | 地区: 常德(常德) | 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:31:22.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768419082 status=200 resp_size=7105
|
||
2026-01-15 03:31:22.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419082&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 03:31:31.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768419091 status=200 resp_size=6531
|
||
2026-01-15 03:31:32.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419091&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 03:31:34.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768419094 status=200 resp_size=6107
|
||
2026-01-15 03:31:34.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419094&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:31:36.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768419096 status=200 resp_size=4704
|
||
2026-01-15 03:31:36.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419096&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 03:31:40.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768419100 status=200 resp_size=6427
|
||
2026-01-15 03:31:40.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419100&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 03:31:51.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768419110 status=200 resp_size=5737
|
||
2026-01-15 03:31:51.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419111&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 03:31:53.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768419113 status=200 resp_size=6113
|
||
2026-01-15 03:31:53.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419113&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:31:57.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768419117 status=200 resp_size=5499
|
||
2026-01-15 03:31:57.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419117&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 03:32:06.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768419126 status=200 resp_size=5880
|
||
2026-01-15 03:32:06.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419126&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 03:32:10.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768419130 status=200 resp_size=5139
|
||
2026-01-15 03:32:10.349 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419130&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:32:15.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768419135 status=200 resp_size=6107
|
||
2026-01-15 03:32:16.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419135&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:32:19.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768419139 status=200 resp_size=5903
|
||
2026-01-15 03:32:19.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419139&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 03:32:21.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768419141 status=200 resp_size=5129
|
||
2026-01-15 03:32:21.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419141&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 03:32:30.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768419150 status=200 resp_size=5241
|
||
2026-01-15 03:32:31.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419150&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:32:37.180 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768419156 status=200 resp_size=6109
|
||
2026-01-15 03:32:37.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419157&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:32:45.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768419165 status=200 resp_size=6111
|
||
2026-01-15 03:32:46.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419165&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:32:47.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768419167 status=200 resp_size=6122
|
||
2026-01-15 03:32:47.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419167&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 03:32:47.779 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
|
||
2026-01-15 03:32:52.932 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 513 条
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 4 条
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 常德(常德)
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 服装/纺织设计总监(3812)
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.23% (513/517)
|
||
2026-01-15 03:32:52.932 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(513) < API返回总数(517),可能存在分页问题或数据过滤
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 03:32:52.932 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 513 条记录)
|
||
2026-01-15 03:32:52.932 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 513 个职位
|
||
2026-01-15 03:32:52.932 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 03:32:59.519 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:32:59.531 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:32:59.873 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 03:32:59.873 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 03:32:59.873 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:32:59.904 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:33:00.437 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:33:01.567 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:33:03.704 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:33:03.704 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:33:04.159 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419179 status=200 resp_size=107956
|
||
2026-01-15 03:33:04.159 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:33:04.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768419184 status=200 resp_size=5029
|
||
2026-01-15 03:33:04.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419184&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 03:33:07.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768419187 status=200 resp_size=5184
|
||
2026-01-15 03:33:07.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419187&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 03:33:09.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768419189 status=200 resp_size=5579
|
||
2026-01-15 03:33:09.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419189&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 03:33:11.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768419191 status=200 resp_size=5000
|
||
2026-01-15 03:33:12.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419191&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 03:33:16.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768419196 status=200 resp_size=4913
|
||
2026-01-15 03:33:16.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419196&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 03:33:18.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768419198 status=200 resp_size=5546
|
||
2026-01-15 03:33:19.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419198&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 03:33:21.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768419201 status=200 resp_size=5630
|
||
2026-01-15 03:33:21.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419201&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 03:33:26.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768419206 status=200 resp_size=6579
|
||
2026-01-15 03:33:26.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419206&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 03:33:32.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768419212 status=200 resp_size=4954
|
||
2026-01-15 03:33:32.838 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419212&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 03:33:39.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768419219 status=200 resp_size=5739
|
||
2026-01-15 03:33:39.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419219&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 03:33:49.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768419229 status=200 resp_size=6192
|
||
2026-01-15 03:33:49.924 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419229&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 03:33:52.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768419232 status=200 resp_size=6139
|
||
2026-01-15 03:33:52.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419232&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 03:33:56.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768419236 status=200 resp_size=5976
|
||
2026-01-15 03:33:56.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419236&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 03:33:59.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768419239 status=200 resp_size=5813
|
||
2026-01-15 03:33:59.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419239&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 03:34:08.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768419248 status=200 resp_size=5890
|
||
2026-01-15 03:34:08.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419248&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:34:18.675 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768419258 status=200 resp_size=4892
|
||
2026-01-15 03:34:18.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419258&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 03:34:28.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768419267 status=200 resp_size=6399
|
||
2026-01-15 03:34:28.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419268&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:34:38.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768419278 status=200 resp_size=5431
|
||
2026-01-15 03:34:38.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419278&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 03:34:48.837 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768419288 status=200 resp_size=6023
|
||
2026-01-15 03:34:48.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419288&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:34:53.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768419293 status=200 resp_size=6048
|
||
2026-01-15 03:34:53.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419293&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:34:53.957 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:34:59.591 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:34:59.591 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 03:34:59.591 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 03:35:03.493 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.90 秒后继续...
|
||
2026-01-15 03:35:03.493 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 03:35:03.493 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:35:03.517 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:35:07.633 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:35:09.205 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:35:11.592 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:35:11.592 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:35:12.517 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419303 status=200 resp_size=108042
|
||
2026-01-15 03:35:12.517 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:35:13.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768419312 status=200 resp_size=6015
|
||
2026-01-15 03:35:14.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419313&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-15 03:35:20.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768419319 status=200 resp_size=6192
|
||
2026-01-15 03:35:20.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419320&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 03:35:28.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768419327 status=200 resp_size=5754
|
||
2026-01-15 03:35:28.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419328&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 03:35:30.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768419330 status=200 resp_size=5721
|
||
2026-01-15 03:35:30.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419330&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 03:35:39.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768419339 status=200 resp_size=5974
|
||
2026-01-15 03:35:40.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419339&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:35:48.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768419347 status=200 resp_size=5638
|
||
2026-01-15 03:35:48.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419348&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 03:35:54.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768419354 status=200 resp_size=6787
|
||
2026-01-15 03:35:55.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419354&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 03:36:04.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768419363 status=200 resp_size=5480
|
||
2026-01-15 03:36:04.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419364&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 03:36:19.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768419373 status=200 resp_size=6137
|
||
2026-01-15 03:36:20.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419379&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 03:36:30.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768419388 status=200 resp_size=5190
|
||
2026-01-15 03:36:31.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419390&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 03:36:40.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768419400 status=200 resp_size=6134
|
||
2026-01-15 03:36:41.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419400&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 03:36:46.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768419406 status=200 resp_size=5589
|
||
2026-01-15 03:36:46.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419406&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 03:36:54.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768419413 status=200 resp_size=6366
|
||
2026-01-15 03:36:54.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419414&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-15 03:37:01.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768419420 status=200 resp_size=5110
|
||
2026-01-15 03:37:01.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419421&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 03:37:04.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768419424 status=200 resp_size=5960
|
||
2026-01-15 03:37:04.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419424&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 03:37:08.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768419428 status=200 resp_size=5613
|
||
2026-01-15 03:37:09.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419428&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:37:10.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768419430 status=200 resp_size=6423
|
||
2026-01-15 03:37:11.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419430&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:37:21.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768419441 status=200 resp_size=5374
|
||
2026-01-15 03:37:22.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419441&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:37:27.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768419447 status=200 resp_size=5486
|
||
2026-01-15 03:37:27.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419447&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 03:37:33.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768419453 status=200 resp_size=5603
|
||
2026-01-15 03:37:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419453&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 03:37:34.209 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:37:39.973 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:37:39.973 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 03:37:42.604 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.62 秒后继续...
|
||
2026-01-15 03:37:42.604 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 03:37:42.604 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:37:42.625 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:37:43.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:37:44.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:37:46.614 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:37:46.614 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:37:47.227 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419462 status=200 resp_size=121747
|
||
2026-01-15 03:37:47.227 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:37:47.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768419467 status=200 resp_size=6179
|
||
2026-01-15 03:37:47.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419467&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 03:37:50.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768419470 status=200 resp_size=5506
|
||
2026-01-15 03:37:50.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419470&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:37:52.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768419471 status=200 resp_size=6076
|
||
2026-01-15 03:37:52.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419472&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 03:37:55.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768419475 status=200 resp_size=5653
|
||
2026-01-15 03:37:55.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419475&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 03:38:03.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768419482 status=200 resp_size=5845
|
||
2026-01-15 03:38:03.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419483&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:38:10.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768419489 status=200 resp_size=5513
|
||
2026-01-15 03:38:10.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419490&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 03:38:20.348 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768419499 status=200 resp_size=6285
|
||
2026-01-15 03:38:20.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419500&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 03:38:30.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768419510 status=200 resp_size=5127
|
||
2026-01-15 03:38:31.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419510&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 03:38:34.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768419513 status=200 resp_size=5677
|
||
2026-01-15 03:38:34.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419514&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 03:38:41.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768419520 status=200 resp_size=5182
|
||
2026-01-15 03:38:41.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419521&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 03:38:48.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768419527 status=200 resp_size=5988
|
||
2026-01-15 03:38:48.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419528&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 03:38:56.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768419536 status=200 resp_size=5333
|
||
2026-01-15 03:38:56.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419536&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:39:09.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768419546 status=200 resp_size=7311
|
||
2026-01-15 03:39:10.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419549&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-15 03:39:20.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768419559 status=200 resp_size=5725
|
||
2026-01-15 03:39:20.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419560&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 03:39:22.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768419562 status=200 resp_size=5729
|
||
2026-01-15 03:39:22.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419562&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:39:28.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768419568 status=200 resp_size=5222
|
||
2026-01-15 03:39:29.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419568&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 03:39:36.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768419575 status=200 resp_size=7499
|
||
2026-01-15 03:39:37.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419576&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 03:39:41.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768419581 status=200 resp_size=5723
|
||
2026-01-15 03:39:42.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419581&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 03:39:51.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768419591 status=200 resp_size=6025
|
||
2026-01-15 03:39:51.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419591&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 03:39:54.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768419594 status=200 resp_size=5245
|
||
2026-01-15 03:39:54.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419594&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 03:39:54.733 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:39:55.015 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:39:55.015 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 03:40:00.494 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.47 秒后继续...
|
||
2026-01-15 03:40:00.494 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 03:40:00.494 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:40:00.526 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:40:01.153 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:40:02.473 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:40:04.702 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:40:04.702 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:40:05.253 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419600 status=200 resp_size=118543
|
||
2026-01-15 03:40:05.253 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:40:05.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768419605 status=200 resp_size=5756
|
||
2026-01-15 03:40:05.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419605&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:40:12.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768419612 status=200 resp_size=6651
|
||
2026-01-15 03:40:12.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419612&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 03:40:22.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768419621 status=200 resp_size=5833
|
||
2026-01-15 03:40:22.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419622&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:40:25.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768419625 status=200 resp_size=6448
|
||
2026-01-15 03:40:25.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419625&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 03:40:35.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768419635 status=200 resp_size=5632
|
||
2026-01-15 03:40:35.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419635&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-15 03:40:43.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768419642 status=200 resp_size=6466
|
||
2026-01-15 03:40:43.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419643&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:40:48.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768419648 status=200 resp_size=5793
|
||
2026-01-15 03:40:48.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419648&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:40:51.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768419651 status=200 resp_size=5803
|
||
2026-01-15 03:40:52.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419651&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:40:53.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768419653 status=200 resp_size=6718
|
||
2026-01-15 03:40:54.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419653&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 03:41:00.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768419659 status=200 resp_size=5961
|
||
2026-01-15 03:41:00.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419660&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:41:04.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768419664 status=200 resp_size=6392
|
||
2026-01-15 03:41:04.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419664&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 03:41:12.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768419670 status=200 resp_size=6049
|
||
2026-01-15 03:41:12.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419672&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:41:14.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768419673 status=200 resp_size=6573
|
||
2026-01-15 03:41:14.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419674&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 03:41:19.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768419678 status=200 resp_size=6511
|
||
2026-01-15 03:41:19.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419679&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 03:41:24.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768419684 status=200 resp_size=5940
|
||
2026-01-15 03:41:25.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419684&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:41:33.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768419692 status=200 resp_size=4058
|
||
2026-01-15 03:41:33.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419693&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 03:41:42.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768419701 status=200 resp_size=6473
|
||
2026-01-15 03:41:42.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419702&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:41:46.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768419706 status=200 resp_size=5232
|
||
2026-01-15 03:41:46.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419706&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:41:54.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768419714 status=200 resp_size=6177
|
||
2026-01-15 03:41:55.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419714&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 03:41:57.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768419717 status=200 resp_size=5634
|
||
2026-01-15 03:41:57.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419717&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:41:57.734 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:42:04.016 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:42:04.016 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 03:42:13.444 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.42 秒后继续...
|
||
2026-01-15 03:42:13.444 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 03:42:13.444 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:42:13.470 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:42:14.066 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:42:15.197 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:42:17.350 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:42:17.350 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:42:17.830 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419733 status=200 resp_size=125022
|
||
2026-01-15 03:42:17.830 | WARNING | __main__:get_recommend_jobs:745 - 第 5 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 03:42:17.836 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:42:18.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768419737 status=200 resp_size=6715
|
||
2026-01-15 03:42:18.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419738&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 03:42:21.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768419741 status=200 resp_size=6125
|
||
2026-01-15 03:42:22.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419741&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:42:30.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768419750 status=200 resp_size=5888
|
||
2026-01-15 03:42:31.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419750&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 03:42:36.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768419756 status=200 resp_size=6055
|
||
2026-01-15 03:42:36.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419756&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 03:42:46.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768419765 status=200 resp_size=5699
|
||
2026-01-15 03:42:46.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419766&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 03:42:55.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768419775 status=200 resp_size=5455
|
||
2026-01-15 03:42:55.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419775&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 03:43:02.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768419781 status=200 resp_size=7534
|
||
2026-01-15 03:43:02.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419782&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 03:43:04.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768419784 status=200 resp_size=6314
|
||
2026-01-15 03:43:04.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419784&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 03:43:11.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768419791 status=200 resp_size=5857
|
||
2026-01-15 03:43:12.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419791&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 03:43:18.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768419798 status=200 resp_size=6024
|
||
2026-01-15 03:43:19.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419798&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:43:21.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768419801 status=200 resp_size=5942
|
||
2026-01-15 03:43:21.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419801&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 03:43:26.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768419806 status=200 resp_size=8574
|
||
2026-01-15 03:43:26.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419806&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 03:43:36.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768419815 status=200 resp_size=7551
|
||
2026-01-15 03:43:36.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419816&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 03:43:42.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768419822 status=200 resp_size=5421
|
||
2026-01-15 03:43:42.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419822&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:43:51.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768419831 status=200 resp_size=5784
|
||
2026-01-15 03:43:51.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419831&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 03:44:00.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768419839 status=200 resp_size=5306
|
||
2026-01-15 03:44:00.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419840&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 03:44:14.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768419849 status=200 resp_size=7182
|
||
2026-01-15 03:44:15.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419854&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 03:44:24.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768419863 status=200 resp_size=5687
|
||
2026-01-15 03:44:24.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419864&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:44:33.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768419871 status=200 resp_size=5407
|
||
2026-01-15 03:44:34.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419873&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 03:44:34.256 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 03:44:34.680 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 03:44:34.680 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 03:44:39.353 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.66 秒后继续...
|
||
2026-01-15 03:44:39.353 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 03:44:39.353 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:44:39.374 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:44:39.892 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:44:41.022 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:44:43.156 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:44:43.156 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:44:43.578 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768419879 status=200 resp_size=157574
|
||
2026-01-15 03:44:43.578 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:44:43.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768419883 status=200 resp_size=6343
|
||
2026-01-15 03:44:43.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419883&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 03:44:48.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768419888 status=200 resp_size=5655
|
||
2026-01-15 03:44:48.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419888&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 03:44:52.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768419892 status=200 resp_size=6958
|
||
2026-01-15 03:44:53.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419892&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:44:59.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768419898 status=200 resp_size=8235
|
||
2026-01-15 03:44:59.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419899&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 03:45:05.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768419905 status=200 resp_size=7119
|
||
2026-01-15 03:45:06.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419905&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 03:45:12.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768419911 status=200 resp_size=5615
|
||
2026-01-15 03:45:12.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419912&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 03:45:19.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768419919 status=200 resp_size=6552
|
||
2026-01-15 03:45:20.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419919&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:45:22.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768419922 status=200 resp_size=6714
|
||
2026-01-15 03:45:23.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419922&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 03:45:32.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768419931 status=200 resp_size=5775
|
||
2026-01-15 03:45:32.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419932&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 03:45:39.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768419938 status=200 resp_size=6696
|
||
2026-01-15 03:45:39.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419939&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 03:45:44.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768419944 status=200 resp_size=5497
|
||
2026-01-15 03:45:44.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419944&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:45:48.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768419948 status=200 resp_size=13102
|
||
2026-01-15 03:45:49.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419948&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 03:45:56.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768419955 status=200 resp_size=5128
|
||
2026-01-15 03:45:56.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419956&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 03:45:58.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768419958 status=200 resp_size=6362
|
||
2026-01-15 03:45:59.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419958&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 03:46:05.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768419964 status=200 resp_size=6689
|
||
2026-01-15 03:46:05.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419965&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:46:08.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768419968 status=200 resp_size=6527
|
||
2026-01-15 03:46:09.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419968&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 03:46:16.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768419976 status=200 resp_size=7130
|
||
2026-01-15 03:46:17.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419976&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 03:46:22.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768419981 status=200 resp_size=7415
|
||
2026-01-15 03:46:22.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419982&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 03:46:31.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768419990 status=200 resp_size=6390
|
||
2026-01-15 03:46:31.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768419991&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:46:41.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768420000 status=200 resp_size=5152
|
||
2026-01-15 03:46:41.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420001&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 03:46:41.626 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:46:48.206 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:46:48.206 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 03:46:50.226 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.01 秒后继续...
|
||
2026-01-15 03:46:50.226 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 03:46:50.226 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:46:50.247 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:46:50.891 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:46:52.085 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:46:54.254 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:46:54.254 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:46:54.772 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420010 status=200 resp_size=147659
|
||
2026-01-15 03:46:54.772 | WARNING | __main__:get_recommend_jobs:745 - 第 7 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 03:46:54.772 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:46:54.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768420014 status=200 resp_size=5877
|
||
2026-01-15 03:46:55.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420014&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 03:47:01.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768420021 status=200 resp_size=5098
|
||
2026-01-15 03:47:02.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420021&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 03:47:03.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768420023 status=200 resp_size=6230
|
||
2026-01-15 03:47:03.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420023&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:47:14.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768420033 status=200 resp_size=5711
|
||
2026-01-15 03:47:14.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420034&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 03:47:16.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768420036 status=200 resp_size=6970
|
||
2026-01-15 03:47:16.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420036&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 03:47:26.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768420045 status=200 resp_size=5109
|
||
2026-01-15 03:47:26.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420046&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 03:47:27.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768420047 status=200 resp_size=8808
|
||
2026-01-15 03:47:27.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420047&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:47:35.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768420055 status=200 resp_size=7717
|
||
2026-01-15 03:47:35.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420055&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 03:47:39.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768420059 status=200 resp_size=8734
|
||
2026-01-15 03:47:39.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420059&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 03:47:49.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768420069 status=200 resp_size=5920
|
||
2026-01-15 03:47:49.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420069&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:48:01.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768420079 status=200 resp_size=4321
|
||
2026-01-15 03:48:01.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420081&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 03:48:04.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768420084 status=200 resp_size=5533
|
||
2026-01-15 03:48:04.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420084&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 03:48:08.464 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768420088 status=200 resp_size=5524
|
||
2026-01-15 03:48:08.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420088&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 03:48:17.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768420096 status=200 resp_size=6445
|
||
2026-01-15 03:48:17.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420097&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:48:19.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768420098 status=200 resp_size=6522
|
||
2026-01-15 03:48:19.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420099&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 03:48:29.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768420108 status=200 resp_size=7756
|
||
2026-01-15 03:48:29.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420109&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 03:48:39.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768420118 status=200 resp_size=6318
|
||
2026-01-15 03:48:39.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420119&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 03:48:42.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768420122 status=200 resp_size=6501
|
||
2026-01-15 03:48:42.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420122&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:48:52.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768420131 status=200 resp_size=5458
|
||
2026-01-15 03:48:52.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420132&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 03:48:52.617 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 03:48:58.643 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 03:48:58.643 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 03:49:03.934 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.28 秒后继续...
|
||
2026-01-15 03:49:03.934 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 03:49:03.934 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:49:03.952 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:49:04.486 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:49:05.618 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:49:07.753 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:49:07.753 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:49:08.209 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420143 status=200 resp_size=137556
|
||
2026-01-15 03:49:08.209 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:49:08.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768420148 status=200 resp_size=7237
|
||
2026-01-15 03:49:08.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420148&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 03:49:12.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768420152 status=200 resp_size=5678
|
||
2026-01-15 03:49:13.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420152&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:49:15.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768420155 status=200 resp_size=5342
|
||
2026-01-15 03:49:16.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420155&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 03:49:26.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768420165 status=200 resp_size=6431
|
||
2026-01-15 03:49:26.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420166&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 03:49:29.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768420168 status=200 resp_size=7607
|
||
2026-01-15 03:49:29.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420169&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 03:49:39.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768420179 status=200 resp_size=8457
|
||
2026-01-15 03:49:40.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420179&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:49:44.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768420184 status=200 resp_size=6416
|
||
2026-01-15 03:49:45.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420184&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 03:49:47.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768420187 status=200 resp_size=5876
|
||
2026-01-15 03:49:47.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420187&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 03:49:51.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768420191 status=200 resp_size=6168
|
||
2026-01-15 03:49:51.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420191&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:49:57.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768420197 status=200 resp_size=6646
|
||
2026-01-15 03:49:58.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420197&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 03:50:07.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768420206 status=200 resp_size=5485
|
||
2026-01-15 03:50:07.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420207&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 03:50:16.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768420215 status=200 resp_size=6511
|
||
2026-01-15 03:50:16.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420216&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:50:20.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768420220 status=200 resp_size=6449
|
||
2026-01-15 03:50:20.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420220&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 03:50:22.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768420222 status=200 resp_size=5925
|
||
2026-01-15 03:50:22.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420222&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 03:50:32.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768420231 status=200 resp_size=7750
|
||
2026-01-15 03:50:32.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420232&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 03:50:38.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768420237 status=200 resp_size=6119
|
||
2026-01-15 03:50:38.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420238&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:50:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768420245 status=200 resp_size=7971
|
||
2026-01-15 03:50:46.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420246&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 03:50:51.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768420250 status=200 resp_size=8313
|
||
2026-01-15 03:50:51.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420251&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 03:50:58.962 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768420258 status=200 resp_size=5424
|
||
2026-01-15 03:50:59.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420258&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 03:51:01.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768420261 status=200 resp_size=6058
|
||
2026-01-15 03:51:01.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420261&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:51:01.897 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:51:08.355 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:51:08.355 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 03:51:15.718 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.36 秒后继续...
|
||
2026-01-15 03:51:15.719 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 03:51:15.719 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:51:15.751 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:51:16.348 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:51:17.510 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:51:19.645 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:51:19.645 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:51:20.164 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420275 status=200 resp_size=162095
|
||
2026-01-15 03:51:20.164 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:51:20.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768420280 status=200 resp_size=8274
|
||
2026-01-15 03:51:20.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420280&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 03:51:27.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768420286 status=200 resp_size=8701
|
||
2026-01-15 03:51:27.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420287&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 03:51:36.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768420295 status=200 resp_size=5211
|
||
2026-01-15 03:51:36.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420296&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 03:51:48.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768420306 status=200 resp_size=6284
|
||
2026-01-15 03:51:48.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420308&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:51:53.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768420312 status=200 resp_size=5378
|
||
2026-01-15 03:51:53.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420313&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 03:51:58.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768420318 status=200 resp_size=7299
|
||
2026-01-15 03:51:58.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420318&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 03:52:03.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768420322 status=200 resp_size=7262
|
||
2026-01-15 03:52:03.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420323&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 03:52:09.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768420329 status=200 resp_size=6254
|
||
2026-01-15 03:52:10.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420329&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:52:17.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768420336 status=200 resp_size=7967
|
||
2026-01-15 03:52:17.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420337&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 03:52:26.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768420345 status=200 resp_size=5253
|
||
2026-01-15 03:52:27.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420346&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 03:52:36.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768420355 status=200 resp_size=5431
|
||
2026-01-15 03:52:36.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420356&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 03:52:44.733 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768420364 status=200 resp_size=4995
|
||
2026-01-15 03:52:44.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420364&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:52:52.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768420371 status=200 resp_size=6080
|
||
2026-01-15 03:52:52.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420372&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 03:52:57.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768420377 status=200 resp_size=5936
|
||
2026-01-15 03:52:57.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420377&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 03:53:06.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768420385 status=200 resp_size=6039
|
||
2026-01-15 03:53:07.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420386&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 03:53:11.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768420391 status=200 resp_size=4916
|
||
2026-01-15 03:53:12.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420391&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 03:53:20.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768420399 status=200 resp_size=5446
|
||
2026-01-15 03:53:20.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420400&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-15 03:53:27.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768420406 status=200 resp_size=6494
|
||
2026-01-15 03:53:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420407&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 03:53:31.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768420411 status=200 resp_size=5860
|
||
2026-01-15 03:53:31.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:53:37.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768420416 status=200 resp_size=6226
|
||
2026-01-15 03:53:37.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420417&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 03:53:37.275 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:53:43.816 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:53:43.816 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 03:53:50.872 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.05 秒后继续...
|
||
2026-01-15 03:53:50.872 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 03:53:50.872 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:53:50.887 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:53:51.672 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:53:52.868 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:53:55.177 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:53:55.177 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:53:55.994 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420430 status=200 resp_size=142102
|
||
2026-01-15 03:53:55.994 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:53:56.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768420435 status=200 resp_size=5613
|
||
2026-01-15 03:53:56.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420436&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 03:54:03.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768420442 status=200 resp_size=6422
|
||
2026-01-15 03:54:03.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420443&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 03:54:11.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768420450 status=200 resp_size=5792
|
||
2026-01-15 03:54:11.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420451&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:54:15.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768420455 status=200 resp_size=6176
|
||
2026-01-15 03:54:15.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420455&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 03:54:18.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768420458 status=200 resp_size=6731
|
||
2026-01-15 03:54:18.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420458&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 03:54:20.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768420459 status=200 resp_size=5575
|
||
2026-01-15 03:54:20.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420460&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 03:54:31.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768420468 status=200 resp_size=6856
|
||
2026-01-15 03:54:31.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420471&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 03:54:36.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768420476 status=200 resp_size=6768
|
||
2026-01-15 03:54:36.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420476&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:54:41.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768420481 status=200 resp_size=5731
|
||
2026-01-15 03:54:41.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420481&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 03:54:52.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768420491 status=200 resp_size=7075
|
||
2026-01-15 03:54:52.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420492&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 03:54:55.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768420495 status=200 resp_size=6530
|
||
2026-01-15 03:54:56.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420495&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:54:58.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768420498 status=200 resp_size=8973
|
||
2026-01-15 03:54:58.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420498&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 03:55:00.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768420500 status=200 resp_size=6313
|
||
2026-01-15 03:55:00.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420500&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 03:55:02.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768420502 status=200 resp_size=8559
|
||
2026-01-15 03:55:02.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420502&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 03:55:07.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768420507 status=200 resp_size=6688
|
||
2026-01-15 03:55:08.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420507&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 03:55:09.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768420509 status=200 resp_size=5290
|
||
2026-01-15 03:55:09.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420509&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 03:55:16.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768420515 status=200 resp_size=5982
|
||
2026-01-15 03:55:16.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420516&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 03:55:19.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768420519 status=200 resp_size=7919
|
||
2026-01-15 03:55:19.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420519&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 03:55:22.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768420522 status=200 resp_size=7681
|
||
2026-01-15 03:55:23.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420522&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 03:55:24.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768420524 status=200 resp_size=5271
|
||
2026-01-15 03:55:24.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420524&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 03:55:24.888 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 03:55:31.233 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 03:55:31.233 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 03:55:40.850 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.60 秒后继续...
|
||
2026-01-15 03:55:40.850 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 03:55:40.850 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:55:40.879 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:55:41.565 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:55:42.713 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:55:44.879 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:55:44.879 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:55:45.413 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420540 status=200 resp_size=135542
|
||
2026-01-15 03:55:45.413 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 03:55:45.413 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:55:45.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768420545 status=200 resp_size=5686
|
||
2026-01-15 03:55:45.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420545&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-15 03:55:52.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768420552 status=200 resp_size=6660
|
||
2026-01-15 03:55:53.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420552&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 03:55:54.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768420554 status=200 resp_size=7952
|
||
2026-01-15 03:55:54.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420554&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 03:56:03.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768420562 status=200 resp_size=5414
|
||
2026-01-15 03:56:03.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420563&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 03:56:13.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768420572 status=200 resp_size=5277
|
||
2026-01-15 03:56:13.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420573&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 03:56:19.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768420578 status=200 resp_size=7175
|
||
2026-01-15 03:56:19.402 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420579&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 03:56:27.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768420586 status=200 resp_size=6284
|
||
2026-01-15 03:56:27.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420587&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:56:31.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768420591 status=200 resp_size=5673
|
||
2026-01-15 03:56:32.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420591&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 03:56:42.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768420601 status=200 resp_size=5924
|
||
2026-01-15 03:56:42.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420602&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 03:56:49.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768420608 status=200 resp_size=6003
|
||
2026-01-15 03:56:49.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420609&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 03:56:51.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768420610 status=200 resp_size=5378
|
||
2026-01-15 03:56:52.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420611&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 03:56:59.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768420617 status=200 resp_size=5084
|
||
2026-01-15 03:56:59.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420619&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:57:03.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768420623 status=200 resp_size=9486
|
||
2026-01-15 03:57:04.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420623&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 03:57:06.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768420626 status=200 resp_size=5363
|
||
2026-01-15 03:57:06.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420626&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 03:57:11.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768420631 status=200 resp_size=13285
|
||
2026-01-15 03:57:12.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420631&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 03:57:20.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768420639 status=200 resp_size=6873
|
||
2026-01-15 03:57:20.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420640&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:57:29.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768420648 status=200 resp_size=6041
|
||
2026-01-15 03:57:29.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420649&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 03:57:33.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768420653 status=200 resp_size=6635
|
||
2026-01-15 03:57:33.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420653&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 03:57:41.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768420660 status=200 resp_size=5390
|
||
2026-01-15 03:57:41.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420661&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 03:57:41.515 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 03:57:47.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 03:57:47.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 03:57:52.077 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.73 秒后继续...
|
||
2026-01-15 03:57:52.077 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 03:57:52.077 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 03:57:52.096 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 03:57:52.788 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:57:53.951 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:57:56.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 03:57:56.119 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 03:57:56.589 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420672 status=200 resp_size=126440
|
||
2026-01-15 03:57:56.589 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 03:57:56.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768420676 status=200 resp_size=8070
|
||
2026-01-15 03:57:56.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420676&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 03:58:03.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768420682 status=200 resp_size=6588
|
||
2026-01-15 03:58:03.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420683&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 03:58:10.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768420689 status=200 resp_size=6300
|
||
2026-01-15 03:58:10.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420690&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 03:58:16.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768420695 status=200 resp_size=7194
|
||
2026-01-15 03:58:16.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420696&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 03:58:25.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768420705 status=200 resp_size=6053
|
||
2026-01-15 03:58:26.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420705&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 03:58:32.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768420711 status=200 resp_size=7170
|
||
2026-01-15 03:58:32.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420712&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 03:58:37.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768420717 status=200 resp_size=4992
|
||
2026-01-15 03:58:37.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420717&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 03:58:47.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768420726 status=200 resp_size=6073
|
||
2026-01-15 03:58:47.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420727&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:58:49.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768420729 status=200 resp_size=7194
|
||
2026-01-15 03:58:50.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420729&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 03:58:56.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768420735 status=200 resp_size=5344
|
||
2026-01-15 03:58:56.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420736&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 03:58:59.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768420739 status=200 resp_size=5554
|
||
2026-01-15 03:59:00.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420739&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 03:59:09.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768420748 status=200 resp_size=5280
|
||
2026-01-15 03:59:10.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420749&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 03:59:16.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768420755 status=200 resp_size=5040
|
||
2026-01-15 03:59:16.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420756&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 03:59:22.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768420761 status=200 resp_size=4993
|
||
2026-01-15 03:59:23.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420762&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 03:59:26.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768420766 status=200 resp_size=6752
|
||
2026-01-15 03:59:26.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420766&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 03:59:33.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768420772 status=200 resp_size=5883
|
||
2026-01-15 03:59:33.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420773&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 03:59:39.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768420778 status=200 resp_size=5764
|
||
2026-01-15 03:59:39.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420779&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 03:59:50.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768420789 status=200 resp_size=5688
|
||
2026-01-15 03:59:51.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420790&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:00:01.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768420800 status=200 resp_size=6980
|
||
2026-01-15 04:00:01.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420801&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 04:00:11.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768420810 status=200 resp_size=5283
|
||
2026-01-15 04:00:11.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420811&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:00:11.867 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:00:12.228 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:00:12.228 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 04:00:15.921 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.69 秒后继续...
|
||
2026-01-15 04:00:15.921 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 04:00:15.921 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:00:15.936 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:00:17.161 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:00:18.386 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:00:20.570 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:00:20.570 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:00:21.276 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420815 status=200 resp_size=150764
|
||
2026-01-15 04:00:21.276 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:00:21.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768420821 status=200 resp_size=5215
|
||
2026-01-15 04:00:21.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420821&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 04:00:27.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768420827 status=200 resp_size=5516
|
||
2026-01-15 04:00:27.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420827&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 04:00:38.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768420837 status=200 resp_size=6659
|
||
2026-01-15 04:00:38.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420838&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:00:44.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768420843 status=200 resp_size=5165
|
||
2026-01-15 04:00:44.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420844&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 04:00:48.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768420847 status=200 resp_size=6856
|
||
2026-01-15 04:00:48.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420848&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 04:00:55.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768420854 status=200 resp_size=5570
|
||
2026-01-15 04:00:56.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420855&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 04:01:06.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768420865 status=200 resp_size=5688
|
||
2026-01-15 04:01:06.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420866&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 04:01:10.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768420870 status=200 resp_size=6380
|
||
2026-01-15 04:01:10.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420870&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 04:01:14.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768420873 status=200 resp_size=6612
|
||
2026-01-15 04:01:14.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420874&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 04:01:21.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768420880 status=200 resp_size=7975
|
||
2026-01-15 04:01:22.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420881&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 04:01:31.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768420890 status=200 resp_size=5984
|
||
2026-01-15 04:01:31.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420891&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 04:01:35.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768420894 status=200 resp_size=7270
|
||
2026-01-15 04:01:35.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420895&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 04:01:39.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768420899 status=200 resp_size=5582
|
||
2026-01-15 04:01:39.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420899&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 04:01:41.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768420901 status=200 resp_size=5924
|
||
2026-01-15 04:01:41.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420901&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 04:01:44.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768420903 status=200 resp_size=6027
|
||
2026-01-15 04:01:44.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420904&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 04:01:52.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768420911 status=200 resp_size=6028
|
||
2026-01-15 04:01:53.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420912&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:02:00.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768420920 status=200 resp_size=8782
|
||
2026-01-15 04:02:01.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420920&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 04:02:08.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768420927 status=200 resp_size=8655
|
||
2026-01-15 04:02:08.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420928&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 04:02:15.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768420934 status=200 resp_size=6935
|
||
2026-01-15 04:02:16.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420935&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 04:02:20.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768420940 status=200 resp_size=6440
|
||
2026-01-15 04:02:20.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420940&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 04:02:20.577 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:02:26.606 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:02:26.622 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 04:02:31.572 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.95 秒后继续...
|
||
2026-01-15 04:02:31.572 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 04:02:31.572 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:02:31.599 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:02:32.321 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:02:33.501 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:02:35.674 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:02:35.674 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:02:36.153 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768420951 status=200 resp_size=147742
|
||
2026-01-15 04:02:36.153 | WARNING | __main__:get_recommend_jobs:745 - 第 14 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 04:02:36.153 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:02:36.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768420956 status=200 resp_size=7907
|
||
2026-01-15 04:02:36.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420956&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 04:02:47.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768420966 status=200 resp_size=4592
|
||
2026-01-15 04:02:47.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420967&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 04:02:49.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768420968 status=200 resp_size=5878
|
||
2026-01-15 04:02:49.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420969&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 04:02:55.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768420975 status=200 resp_size=6437
|
||
2026-01-15 04:02:56.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420975&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 04:03:03.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768420982 status=200 resp_size=5672
|
||
2026-01-15 04:03:03.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420983&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 04:03:10.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768420989 status=200 resp_size=9108
|
||
2026-01-15 04:03:10.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420990&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 04:03:14.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768420994 status=200 resp_size=6111
|
||
2026-01-15 04:03:14.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768420994&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 04:03:25.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768421003 status=200 resp_size=6958
|
||
2026-01-15 04:03:26.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421005&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 04:03:37.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768421016 status=200 resp_size=7313
|
||
2026-01-15 04:03:37.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421017&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 04:03:44.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768421024 status=200 resp_size=6694
|
||
2026-01-15 04:03:45.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421024&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 04:03:46.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768421026 status=200 resp_size=6568
|
||
2026-01-15 04:03:46.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421026&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 04:03:48.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768421027 status=200 resp_size=5922
|
||
2026-01-15 04:03:48.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421028&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 04:03:54.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768421033 status=200 resp_size=5499
|
||
2026-01-15 04:03:54.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421034&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 04:03:59.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768421039 status=200 resp_size=6184
|
||
2026-01-15 04:03:59.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421039&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 04:04:03.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768421043 status=200 resp_size=5673
|
||
2026-01-15 04:04:04.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421043&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 04:04:06.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768421045 status=200 resp_size=7079
|
||
2026-01-15 04:04:06.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421046&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 04:04:12.629 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768421051 status=200 resp_size=7664
|
||
2026-01-15 04:04:12.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421052&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 04:04:14.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768421054 status=200 resp_size=6652
|
||
2026-01-15 04:04:14.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421054&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 04:04:22.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768421062 status=200 resp_size=4733
|
||
2026-01-15 04:04:23.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421062&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:04:23.060 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 04:04:29.062 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 04:04:29.062 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 04:04:30.740 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.67 秒后继续...
|
||
2026-01-15 04:04:30.740 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 04:04:30.740 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:04:30.759 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:04:31.450 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:04:32.629 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:04:34.813 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:04:34.813 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:04:35.316 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421070 status=200 resp_size=134779
|
||
2026-01-15 04:04:35.316 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:04:35.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768421075 status=200 resp_size=4926
|
||
2026-01-15 04:04:35.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421075&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 04:04:38.949 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768421078 status=200 resp_size=4906
|
||
2026-01-15 04:04:39.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421078&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 04:04:48.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768421087 status=200 resp_size=7369
|
||
2026-01-15 04:04:49.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421088&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 04:04:51.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768421091 status=200 resp_size=4834
|
||
2026-01-15 04:04:51.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421091&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:05:00.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768421099 status=200 resp_size=5006
|
||
2026-01-15 04:05:00.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421100&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 04:05:03.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768421103 status=200 resp_size=5363
|
||
2026-01-15 04:05:03.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421103&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 04:05:09.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768421108 status=200 resp_size=5232
|
||
2026-01-15 04:05:09.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421109&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 04:05:13.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768421113 status=200 resp_size=6946
|
||
2026-01-15 04:05:13.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421113&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 04:05:16.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768421116 status=200 resp_size=4956
|
||
2026-01-15 04:05:16.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421116&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:05:26.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768421125 status=200 resp_size=7382
|
||
2026-01-15 04:05:27.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421126&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 04:05:37.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768421136 status=200 resp_size=7331
|
||
2026-01-15 04:05:38.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421137&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 04:05:43.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768421142 status=200 resp_size=5087
|
||
2026-01-15 04:05:43.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421143&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 04:05:51.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768421150 status=200 resp_size=6551
|
||
2026-01-15 04:05:51.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421151&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 04:06:11.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768421160 status=200 resp_size=4515
|
||
2026-01-15 04:06:14.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421171&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 04:06:22.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768421181 status=200 resp_size=4865
|
||
2026-01-15 04:06:23.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421182&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 04:06:30.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768421188 status=200 resp_size=5241
|
||
2026-01-15 04:06:30.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421190&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 04:06:40.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768421200 status=200 resp_size=5494
|
||
2026-01-15 04:06:41.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421200&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 04:06:47.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768421206 status=200 resp_size=6572
|
||
2026-01-15 04:06:49.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421207&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 04:06:56.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job×tamp=1768421216 status=200 resp_size=6576
|
||
2026-01-15 04:06:57.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421216&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 04:07:01.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768421221 status=200 resp_size=5674
|
||
2026-01-15 04:07:01.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421221&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 04:07:01.705 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:07:07.531 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:07:07.531 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 04:07:12.589 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.05 秒后继续...
|
||
2026-01-15 04:07:12.589 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 04:07:12.589 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:07:12.604 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:07:13.265 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:07:14.412 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:07:16.563 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:07:16.563 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:07:16.988 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421232 status=200 resp_size=130077
|
||
2026-01-15 04:07:16.988 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:07:17.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768421237 status=200 resp_size=6303
|
||
2026-01-15 04:07:17.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421237&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 04:07:18.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768421238 status=200 resp_size=6139
|
||
2026-01-15 04:07:19.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421238&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 04:07:21.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768421241 status=200 resp_size=5471
|
||
2026-01-15 04:07:21.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421241&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 04:07:26.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768421246 status=200 resp_size=5725
|
||
2026-01-15 04:07:26.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421246&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 04:07:33.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768421252 status=200 resp_size=4737
|
||
2026-01-15 04:07:34.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421253&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 04:07:38.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768421258 status=200 resp_size=4297
|
||
2026-01-15 04:07:39.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421258&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 04:07:48.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768421267 status=200 resp_size=5259
|
||
2026-01-15 04:07:48.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421268&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 04:07:54.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job×tamp=1768421273 status=200 resp_size=4786
|
||
2026-01-15 04:07:54.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421274&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 04:07:57.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768421277 status=200 resp_size=5746
|
||
2026-01-15 04:07:58.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421277&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 04:08:08.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768421287 status=200 resp_size=5466
|
||
2026-01-15 04:08:08.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421288&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 04:08:13.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768421292 status=200 resp_size=5037
|
||
2026-01-15 04:08:13.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421293&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 04:08:23.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768421302 status=200 resp_size=5631
|
||
2026-01-15 04:08:23.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421303&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 04:08:28.112 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768421307 status=200 resp_size=5979
|
||
2026-01-15 04:08:28.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421308&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 04:08:36.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768421315 status=200 resp_size=6264
|
||
2026-01-15 04:08:36.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421316&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 04:08:39.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768421319 status=200 resp_size=5973
|
||
2026-01-15 04:08:40.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421319&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 04:08:50.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768421328 status=200 resp_size=5928
|
||
2026-01-15 04:08:51.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421330&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 04:08:58.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768421337 status=200 resp_size=4719
|
||
2026-01-15 04:09:00.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421338&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 04:09:10.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768421349 status=200 resp_size=6295
|
||
2026-01-15 04:09:10.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421350&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 04:09:12.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768421352 status=200 resp_size=5806
|
||
2026-01-15 04:09:13.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421352&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:09:25.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768421360 status=200 resp_size=5174
|
||
2026-01-15 04:09:26.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421365&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 04:09:26.211 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:09:32.015 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:09:32.015 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 04:09:40.848 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.82 秒后继续...
|
||
2026-01-15 04:09:40.848 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 04:09:40.848 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:09:40.872 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:09:44.626 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:09:45.866 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:09:48.018 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:09:48.018 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:09:48.592 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421380 status=200 resp_size=124077
|
||
2026-01-15 04:09:48.592 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:09:48.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768421388 status=200 resp_size=6666
|
||
2026-01-15 04:09:48.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421388&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 04:09:51.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768421391 status=200 resp_size=4654
|
||
2026-01-15 04:09:51.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421391&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 04:09:58.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768421397 status=200 resp_size=7057
|
||
2026-01-15 04:09:59.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421398&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 04:10:07.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768421407 status=200 resp_size=7248
|
||
2026-01-15 04:10:08.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421407&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:10:17.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768421416 status=200 resp_size=6546
|
||
2026-01-15 04:10:17.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421417&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 04:10:24.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768421423 status=200 resp_size=6546
|
||
2026-01-15 04:10:24.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421424&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 04:10:33.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job×tamp=1768421433 status=200 resp_size=4679
|
||
2026-01-15 04:10:34.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421433&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
|
||
2026-01-15 04:10:41.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768421440 status=200 resp_size=4783
|
||
2026-01-15 04:10:41.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421441&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 04:10:46.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768421446 status=200 resp_size=5359
|
||
2026-01-15 04:10:46.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421446&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:10:50.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768421450 status=200 resp_size=6326
|
||
2026-01-15 04:10:51.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421450&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 04:11:00.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768421460 status=200 resp_size=5106
|
||
2026-01-15 04:11:01.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421460&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 04:11:10.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768421470 status=200 resp_size=4572
|
||
2026-01-15 04:11:11.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421470&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 04:11:13.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768421473 status=200 resp_size=5306
|
||
2026-01-15 04:11:13.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421473&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 04:11:16.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768421476 status=200 resp_size=6325
|
||
2026-01-15 04:11:17.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421476&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 04:11:21.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768421481 status=200 resp_size=6073
|
||
2026-01-15 04:11:21.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421481&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 04:11:27.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768421487 status=200 resp_size=5111
|
||
2026-01-15 04:11:28.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421487&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 04:11:34.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768421493 status=200 resp_size=5915
|
||
2026-01-15 04:11:34.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421494&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 04:11:41.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768421500 status=200 resp_size=5282
|
||
2026-01-15 04:11:41.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421501&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 04:11:49.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job×tamp=1768421508 status=200 resp_size=7722
|
||
2026-01-15 04:11:49.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421509&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 04:11:52.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768421512 status=200 resp_size=5294
|
||
2026-01-15 04:11:53.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421512&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:11:53.008 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:11:53.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:11:53.338 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 04:12:00.755 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.41 秒后继续...
|
||
2026-01-15 04:12:00.755 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 04:12:00.755 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:12:00.783 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:12:05.888 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:12:07.050 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:12:09.234 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:12:09.234 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:12:09.752 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421520 status=200 resp_size=130603
|
||
2026-01-15 04:12:09.752 | WARNING | __main__:get_recommend_jobs:745 - 第 18 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 04:12:09.752 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:12:09.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768421529 status=200 resp_size=5943
|
||
2026-01-15 04:12:10.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421529&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 04:12:20.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768421539 status=200 resp_size=7688
|
||
2026-01-15 04:12:20.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421540&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 04:12:23.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768421543 status=200 resp_size=4757
|
||
2026-01-15 04:12:23.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421543&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 04:12:28.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768421547 status=200 resp_size=5693
|
||
2026-01-15 04:12:28.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421548&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:12:34.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768421554 status=200 resp_size=5853
|
||
2026-01-15 04:12:35.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421554&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 04:12:39.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768421559 status=200 resp_size=5360
|
||
2026-01-15 04:12:39.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421559&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 04:12:49.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768421568 status=200 resp_size=5666
|
||
2026-01-15 04:12:49.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421569&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 04:12:59.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768421578 status=200 resp_size=5591
|
||
2026-01-15 04:12:59.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421579&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:13:01.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768421581 status=200 resp_size=5651
|
||
2026-01-15 04:13:01.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421581&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 04:13:09.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job×tamp=1768421588 status=200 resp_size=4864
|
||
2026-01-15 04:13:09.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421589&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:13:17.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768421596 status=200 resp_size=4333
|
||
2026-01-15 04:13:17.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421597&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 04:13:21.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768421600 status=200 resp_size=5317
|
||
2026-01-15 04:13:21.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421601&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:13:31.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768421610 status=200 resp_size=6269
|
||
2026-01-15 04:13:31.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421611&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 04:13:35.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768421615 status=200 resp_size=5481
|
||
2026-01-15 04:13:35.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421615&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 04:13:37.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768421616 status=200 resp_size=6454
|
||
2026-01-15 04:13:37.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421617&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:13:41.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768421620 status=200 resp_size=5510
|
||
2026-01-15 04:13:41.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421621&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:13:46.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768421625 status=200 resp_size=8675
|
||
2026-01-15 04:13:46.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421626&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 04:13:48.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768421628 status=200 resp_size=5938
|
||
2026-01-15 04:13:49.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421628&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 04:13:56.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768421635 status=200 resp_size=6458
|
||
2026-01-15 04:13:56.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421636&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:13:56.876 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 04:13:57.191 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 04:13:57.191 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 04:14:05.999 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.80 秒后继续...
|
||
2026-01-15 04:14:05.999 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 04:14:06.002 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:14:06.017 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:14:07.320 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:14:09.144 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:14:11.595 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:14:11.595 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:14:12.410 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421646 status=200 resp_size=114103
|
||
2026-01-15 04:14:12.410 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:14:12.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768421652 status=200 resp_size=8440
|
||
2026-01-15 04:14:12.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421652&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 04:14:19.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768421658 status=200 resp_size=5227
|
||
2026-01-15 04:14:19.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421659&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 04:14:22.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768421661 status=200 resp_size=5162
|
||
2026-01-15 04:14:22.380 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421662&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 04:14:28.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768421667 status=200 resp_size=6414
|
||
2026-01-15 04:14:28.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421668&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 04:14:35.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768421674 status=200 resp_size=6062
|
||
2026-01-15 04:14:36.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421675&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 04:14:42.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768421681 status=200 resp_size=5449
|
||
2026-01-15 04:14:42.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421682&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 04:14:44.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768421683 status=200 resp_size=5708
|
||
2026-01-15 04:14:44.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421684&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 04:14:51.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768421690 status=200 resp_size=6976
|
||
2026-01-15 04:14:51.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421691&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 04:14:54.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768421694 status=200 resp_size=5837
|
||
2026-01-15 04:14:54.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421694&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 04:14:58.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768421698 status=200 resp_size=5506
|
||
2026-01-15 04:14:59.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421698&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 04:15:09.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768421708 status=200 resp_size=5845
|
||
2026-01-15 04:15:09.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421709&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 04:15:11.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768421711 status=200 resp_size=6139
|
||
2026-01-15 04:15:11.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421711&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 04:15:19.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768421718 status=200 resp_size=5599
|
||
2026-01-15 04:15:19.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421719&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 04:15:24.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768421724 status=200 resp_size=5636
|
||
2026-01-15 04:15:26.042 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421724&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 04:15:32.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768421732 status=200 resp_size=6222
|
||
2026-01-15 04:15:33.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421732&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 04:15:41.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768421740 status=200 resp_size=7704
|
||
2026-01-15 04:15:41.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421741&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 04:15:43.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768421743 status=200 resp_size=5400
|
||
2026-01-15 04:15:43.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421743&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 04:15:52.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768421751 status=200 resp_size=5846
|
||
2026-01-15 04:15:52.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421752&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 04:15:56.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768421756 status=200 resp_size=4627
|
||
2026-01-15 04:15:56.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421756&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 04:16:04.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768421763 status=200 resp_size=6090
|
||
2026-01-15 04:16:05.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421764&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:16:05.144 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:16:10.846 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:16:10.846 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 04:16:14.834 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.98 秒后继续...
|
||
2026-01-15 04:16:14.834 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 04:16:14.834 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:16:14.852 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:16:15.557 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:16:16.720 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:16:18.892 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:16:18.892 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:16:19.326 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421774 status=200 resp_size=108282
|
||
2026-01-15 04:16:19.326 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:16:19.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768421779 status=200 resp_size=6346
|
||
2026-01-15 04:16:19.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421779&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 04:16:29.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768421788 status=200 resp_size=6896
|
||
2026-01-15 04:16:29.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421789&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 04:16:36.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768421795 status=200 resp_size=5290
|
||
2026-01-15 04:16:36.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421796&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 04:16:46.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768421805 status=200 resp_size=5976
|
||
2026-01-15 04:16:46.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421806&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:16:53.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768421812 status=200 resp_size=6435
|
||
2026-01-15 04:16:53.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421813&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 04:16:59.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768421819 status=200 resp_size=6490
|
||
2026-01-15 04:17:00.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421819&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 04:17:09.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768421828 status=200 resp_size=6194
|
||
2026-01-15 04:17:10.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421829&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 04:17:18.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768421837 status=200 resp_size=6078
|
||
2026-01-15 04:17:18.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421838&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:17:26.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768421845 status=200 resp_size=5526
|
||
2026-01-15 04:17:26.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421846&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 04:17:29.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768421849 status=200 resp_size=6819
|
||
2026-01-15 04:17:29.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421849&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 04:17:40.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768421859 status=200 resp_size=5830
|
||
2026-01-15 04:17:40.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421860&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 04:17:43.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768421863 status=200 resp_size=4786
|
||
2026-01-15 04:17:43.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421863&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:17:46.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768421865 status=200 resp_size=6984
|
||
2026-01-15 04:17:46.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421866&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 04:17:54.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768421874 status=200 resp_size=5432
|
||
2026-01-15 04:17:55.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421874&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 04:18:05.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768421884 status=200 resp_size=6066
|
||
2026-01-15 04:18:05.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421885&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 04:18:13.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768421892 status=200 resp_size=5541
|
||
2026-01-15 04:18:13.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421893&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 04:18:17.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768421897 status=200 resp_size=6058
|
||
2026-01-15 04:18:17.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421897&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 04:18:23.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768421903 status=200 resp_size=5879
|
||
2026-01-15 04:18:24.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421903&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 04:18:26.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768421906 status=200 resp_size=5379
|
||
2026-01-15 04:18:26.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421906&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 04:18:35.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768421914 status=200 resp_size=5655
|
||
2026-01-15 04:18:35.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421915&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 04:18:35.376 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:18:35.658 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:18:35.658 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 04:18:37.385 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.72 秒后继续...
|
||
2026-01-15 04:18:37.385 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 04:18:37.385 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:18:37.416 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:18:38.122 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:18:39.321 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:18:41.483 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:18:41.483 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:18:42.048 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768421917 status=200 resp_size=113762
|
||
2026-01-15 04:18:42.048 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:18:42.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768421922 status=200 resp_size=6286
|
||
2026-01-15 04:18:42.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421922&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 04:18:51.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768421930 status=200 resp_size=5496
|
||
2026-01-15 04:18:51.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421931&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 04:18:54.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768421934 status=200 resp_size=6106
|
||
2026-01-15 04:18:55.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421934&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 04:19:00.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768421940 status=200 resp_size=6326
|
||
2026-01-15 04:19:01.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421940&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 04:19:11.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768421950 status=200 resp_size=5398
|
||
2026-01-15 04:19:12.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421951&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 04:19:15.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768421955 status=200 resp_size=5294
|
||
2026-01-15 04:19:15.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421955&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:19:26.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768421965 status=200 resp_size=5984
|
||
2026-01-15 04:19:26.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421966&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 04:19:31.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768421970 status=200 resp_size=5662
|
||
2026-01-15 04:19:31.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421971&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 04:19:40.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768421979 status=200 resp_size=5835
|
||
2026-01-15 04:19:40.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421980&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 04:19:43.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768421983 status=200 resp_size=6131
|
||
2026-01-15 04:19:43.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421983&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 04:19:53.369 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768421992 status=200 resp_size=6112
|
||
2026-01-15 04:19:53.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421993&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:19:55.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768421995 status=200 resp_size=5951
|
||
2026-01-15 04:19:55.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768421995&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 04:20:01.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768422001 status=200 resp_size=6219
|
||
2026-01-15 04:20:02.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422001&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 04:20:05.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768422005 status=200 resp_size=6039
|
||
2026-01-15 04:20:05.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422005&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 04:20:14.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768422013 status=200 resp_size=5675
|
||
2026-01-15 04:20:14.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422014&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:20:18.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768422017 status=200 resp_size=5849
|
||
2026-01-15 04:20:18.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422018&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 04:20:29.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768422028 status=200 resp_size=5335
|
||
2026-01-15 04:20:29.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422029&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:20:32.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768422031 status=200 resp_size=6351
|
||
2026-01-15 04:20:32.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422032&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 04:20:42.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768422041 status=200 resp_size=6113
|
||
2026-01-15 04:20:42.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422042&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:20:46.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768422046 status=200 resp_size=5829
|
||
2026-01-15 04:20:46.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422046&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 04:20:46.783 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:20:52.388 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:20:52.388 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 04:21:00.231 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.83 秒后继续...
|
||
2026-01-15 04:21:00.231 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 04:21:00.231 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:21:00.257 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:21:01.340 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:21:02.518 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:21:04.669 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:21:04.669 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:21:05.235 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422060 status=200 resp_size=140524
|
||
2026-01-15 04:21:05.235 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:21:05.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768422065 status=200 resp_size=6321
|
||
2026-01-15 04:21:05.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422065&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:21:10.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768422070 status=200 resp_size=5095
|
||
2026-01-15 04:21:10.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422070&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 04:21:21.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768422080 status=200 resp_size=6385
|
||
2026-01-15 04:21:21.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422081&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:21:28.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768422087 status=200 resp_size=5107
|
||
2026-01-15 04:21:29.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422088&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 04:21:35.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768422094 status=200 resp_size=6497
|
||
2026-01-15 04:21:35.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422095&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:21:37.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768422096 status=200 resp_size=4774
|
||
2026-01-15 04:21:37.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422097&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 04:21:41.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768422101 status=200 resp_size=6963
|
||
2026-01-15 04:21:41.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422101&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:21:48.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768422107 status=200 resp_size=5463
|
||
2026-01-15 04:21:48.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422108&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 04:21:57.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768422117 status=200 resp_size=5473
|
||
2026-01-15 04:21:57.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422117&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:22:08.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768422127 status=200 resp_size=5448
|
||
2026-01-15 04:22:08.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422128&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:22:15.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768422134 status=200 resp_size=7079
|
||
2026-01-15 04:22:15.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422135&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 04:22:22.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768422141 status=200 resp_size=6053
|
||
2026-01-15 04:22:22.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422142&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 04:22:27.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768422147 status=200 resp_size=6074
|
||
2026-01-15 04:22:27.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422147&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:22:31.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768422151 status=200 resp_size=5197
|
||
2026-01-15 04:22:31.833 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422151&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:22:35.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768422155 status=200 resp_size=7337
|
||
2026-01-15 04:22:35.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422155&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 04:22:38.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768422158 status=200 resp_size=6216
|
||
2026-01-15 04:22:38.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422158&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 04:22:42.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768422162 status=200 resp_size=5503
|
||
2026-01-15 04:22:42.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422162&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:22:44.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768422164 status=200 resp_size=5703
|
||
2026-01-15 04:22:44.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422164&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:22:51.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768422170 status=200 resp_size=5924
|
||
2026-01-15 04:22:51.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422171&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 04:22:56.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768422175 status=200 resp_size=6275
|
||
2026-01-15 04:22:56.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422176&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 04:22:56.395 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:23:02.507 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:23:02.507 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 04:23:11.590 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.08 秒后继续...
|
||
2026-01-15 04:23:11.590 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 04:23:11.590 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:23:11.617 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:23:12.403 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:23:13.598 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:23:15.769 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:23:15.782 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:23:16.252 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422191 status=200 resp_size=138359
|
||
2026-01-15 04:23:16.252 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:23:16.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768422196 status=200 resp_size=5236
|
||
2026-01-15 04:23:16.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422196&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:23:27.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768422205 status=200 resp_size=4841
|
||
2026-01-15 04:23:27.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422207&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:23:34.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768422214 status=200 resp_size=6316
|
||
2026-01-15 04:23:35.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422214&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 04:23:43.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job×tamp=1768422223 status=200 resp_size=6215
|
||
2026-01-15 04:23:44.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422223&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
|
||
2026-01-15 04:23:45.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768422225 status=200 resp_size=5321
|
||
2026-01-15 04:23:46.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422225&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:23:54.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768422233 status=200 resp_size=5112
|
||
2026-01-15 04:23:54.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422234&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:24:01.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768422240 status=200 resp_size=6150
|
||
2026-01-15 04:24:01.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422241&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 04:24:11.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768422250 status=200 resp_size=5188
|
||
2026-01-15 04:24:11.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422251&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:24:14.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768422254 status=200 resp_size=5166
|
||
2026-01-15 04:24:14.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422254&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:24:23.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768422262 status=200 resp_size=5373
|
||
2026-01-15 04:24:23.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422263&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:24:25.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768422265 status=200 resp_size=5148
|
||
2026-01-15 04:24:26.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422265&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:24:27.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768422267 status=200 resp_size=4861
|
||
2026-01-15 04:24:27.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422267&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:24:35.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768422274 status=200 resp_size=5055
|
||
2026-01-15 04:24:35.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422275&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:24:42.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768422281 status=200 resp_size=4962
|
||
2026-01-15 04:24:42.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422282&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:24:53.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768422292 status=200 resp_size=4847
|
||
2026-01-15 04:24:53.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422293&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:25:01.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768422300 status=200 resp_size=5409
|
||
2026-01-15 04:25:01.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422301&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:25:05.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768422304 status=200 resp_size=5600
|
||
2026-01-15 04:25:05.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422305&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:25:15.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768422314 status=200 resp_size=5570
|
||
2026-01-15 04:25:15.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422315&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:25:26.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768422325 status=200 resp_size=5032
|
||
2026-01-15 04:25:26.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422326&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:25:28.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768422328 status=200 resp_size=5461
|
||
2026-01-15 04:25:28.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422328&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:25:28.923 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:25:29.284 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:25:29.284 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 04:25:33.260 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.96 秒后继续...
|
||
2026-01-15 04:25:33.260 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 04:25:33.260 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:25:33.288 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:25:34.152 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:25:35.362 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:25:37.562 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:25:37.562 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:25:38.080 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422333 status=200 resp_size=131472
|
||
2026-01-15 04:25:38.080 | WARNING | __main__:get_recommend_jobs:745 - 第 24 页发现 2 个重复职位(已跳过)
|
||
2026-01-15 04:25:38.080 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 18) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:25:38.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768422338 status=200 resp_size=5182
|
||
2026-01-15 04:25:38.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422338&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:25:46.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768422345 status=200 resp_size=5200
|
||
2026-01-15 04:25:46.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422346&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:25:57.397 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): 517 Proxy Setup Failed
|
||
2026-01-15 04:25:57.397 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: 517 Proxy Setup Failed
|
||
2026-01-15 04:25:57.397 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:25:57.397 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-15 04:25:57.397 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:25:58.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768422352 status=200 resp_size=5552
|
||
2026-01-15 04:25:58.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422358&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:26:08.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768422368 status=200 resp_size=5207
|
||
2026-01-15 04:26:09.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422368&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:26:13.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768422373 status=200 resp_size=5489
|
||
2026-01-15 04:26:14.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422373&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:26:18.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768422378 status=200 resp_size=5173
|
||
2026-01-15 04:26:18.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422378&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:26:23.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768422383 status=200 resp_size=5295
|
||
2026-01-15 04:26:24.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422383&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:26:28.600 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768422388 status=200 resp_size=4383
|
||
2026-01-15 04:26:28.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422388&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 04:26:38.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768422397 status=200 resp_size=10634
|
||
2026-01-15 04:26:38.401 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422398&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 04:26:47.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768422406 status=200 resp_size=4990
|
||
2026-01-15 04:26:48.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422407&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 04:26:50.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768422410 status=200 resp_size=4985
|
||
2026-01-15 04:26:50.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422410&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:26:57.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768422416 status=200 resp_size=5236
|
||
2026-01-15 04:26:57.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422417&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 04:26:58.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768422418 status=200 resp_size=4315
|
||
2026-01-15 04:26:58.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422418&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 04:27:07.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768422427 status=200 resp_size=7628
|
||
2026-01-15 04:27:08.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422427&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 04:27:16.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768422435 status=200 resp_size=4972
|
||
2026-01-15 04:27:16.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422436&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:27:21.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768422441 status=200 resp_size=6095
|
||
2026-01-15 04:27:21.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422441&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:27:25.334 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768422445 status=200 resp_size=5147
|
||
2026-01-15 04:27:25.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422445&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 04:27:30.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768422449 status=200 resp_size=6401
|
||
2026-01-15 04:27:30.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422450&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:27:30.240 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 18
|
||
2026-01-15 04:27:30.492 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
|
||
2026-01-15 04:27:30.492 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 04:27:32.246 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.75 秒后继续...
|
||
2026-01-15 04:27:32.246 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 04:27:32.246 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:27:32.267 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:27:33.051 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:27:34.246 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:27:36.429 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:27:36.429 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:27:36.916 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422452 status=200 resp_size=134250
|
||
2026-01-15 04:27:36.947 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:27:37.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768422456 status=200 resp_size=5158
|
||
2026-01-15 04:27:37.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422457&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:27:39.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768422459 status=200 resp_size=6101
|
||
2026-01-15 04:27:40.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422459&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:27:43.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768422463 status=200 resp_size=4991
|
||
2026-01-15 04:27:43.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422463&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 04:27:53.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768422472 status=200 resp_size=6793
|
||
2026-01-15 04:27:53.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422473&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:28:03.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768422482 status=200 resp_size=4978
|
||
2026-01-15 04:28:03.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422483&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:28:04.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768422484 status=200 resp_size=6117
|
||
2026-01-15 04:28:05.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422484&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:28:06.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768422486 status=200 resp_size=5111
|
||
2026-01-15 04:28:07.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422486&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:28:11.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768422491 status=200 resp_size=4835
|
||
2026-01-15 04:28:11.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422491&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 04:28:20.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768422499 status=200 resp_size=5026
|
||
2026-01-15 04:28:20.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422500&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:28:29.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768422509 status=200 resp_size=6108
|
||
2026-01-15 04:28:30.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422509&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:28:31.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768422511 status=200 resp_size=7131
|
||
2026-01-15 04:28:32.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422511&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 04:28:38.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768422518 status=200 resp_size=6794
|
||
2026-01-15 04:28:39.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422518&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:28:43.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768422523 status=200 resp_size=4859
|
||
2026-01-15 04:28:43.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422523&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:28:46.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768422526 status=200 resp_size=6109
|
||
2026-01-15 04:28:47.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422526&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:28:53.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768422532 status=200 resp_size=6749
|
||
2026-01-15 04:28:53.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422533&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 04:29:03.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768422542 status=200 resp_size=5992
|
||
2026-01-15 04:29:03.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422543&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 04:29:06.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768422546 status=200 resp_size=6115
|
||
2026-01-15 04:29:06.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422546&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:29:14.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768422554 status=200 resp_size=6544
|
||
2026-01-15 04:29:15.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422554&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 04:29:22.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768422562 status=200 resp_size=7105
|
||
2026-01-15 04:29:23.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422562&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 04:29:29.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768422569 status=200 resp_size=6044
|
||
2026-01-15 04:29:30.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422569&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:29:30.143 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:29:36.220 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:29:36.220 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 04:29:42.793 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.56 秒后继续...
|
||
2026-01-15 04:29:42.793 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 04:29:42.793 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:29:42.814 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=惠州, 工作类型=3335
|
||
2026-01-15 04:29:43.489 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:29:44.636 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:29:46.805 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:29:46.805 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:29:47.292 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422582 status=200 resp_size=112427
|
||
2026-01-15 04:29:47.292 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17) | API返回totalCount: 517 (原始值: 517) | 地区: 惠州(惠州) | 职能: 互联网金融(3335)
|
||
2026-01-15 04:29:47.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768422587 status=200 resp_size=6531
|
||
2026-01-15 04:29:47.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422587&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 04:29:55.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768422594 status=200 resp_size=4704
|
||
2026-01-15 04:29:55.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422595&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 04:30:03.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768422602 status=200 resp_size=6427
|
||
2026-01-15 04:30:03.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422603&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 04:30:11.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768422610 status=200 resp_size=6107
|
||
2026-01-15 04:30:11.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422611&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:30:14.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768422613 status=200 resp_size=5737
|
||
2026-01-15 04:30:14.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422614&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 04:30:22.098 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768422621 status=200 resp_size=5499
|
||
2026-01-15 04:30:22.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422622&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 04:30:24.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768422624 status=200 resp_size=6113
|
||
2026-01-15 04:30:24.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422624&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:30:31.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768422631 status=200 resp_size=5880
|
||
2026-01-15 04:30:32.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422631&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:30:36.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768422636 status=200 resp_size=5139
|
||
2026-01-15 04:30:36.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422636&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:30:44.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768422643 status=200 resp_size=5903
|
||
2026-01-15 04:30:44.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422644&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 04:30:52.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768422652 status=200 resp_size=6107
|
||
2026-01-15 04:30:53.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422652&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:31:02.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768422661 status=200 resp_size=5129
|
||
2026-01-15 04:31:02.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422662&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 04:31:04.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768422664 status=200 resp_size=5241
|
||
2026-01-15 04:31:05.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422664&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:31:11.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768422670 status=200 resp_size=6109
|
||
2026-01-15 04:31:11.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422671&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:31:21.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768422681 status=200 resp_size=6111
|
||
2026-01-15 04:31:21.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422681&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:31:29.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768422687 status=200 resp_size=6122
|
||
2026-01-15 04:31:29.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422689&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 04:31:36.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768422696 status=200 resp_size=5151
|
||
2026-01-15 04:31:37.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422696&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:31:37.678 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
|
||
2026-01-15 04:31:42.734 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 510 条
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 7 条
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 惠州(惠州)
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 互联网金融(3335)
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 98.65% (510/517)
|
||
2026-01-15 04:31:42.734 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(510) < API返回总数(517),可能存在分页问题或数据过滤
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 04:31:42.734 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 510 条记录)
|
||
2026-01-15 04:31:42.734 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 510 个职位
|
||
2026-01-15 04:31:42.734 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 04:31:45.196 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:31:45.200 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:31:45.467 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 04:31:45.467 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 04:31:45.467 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:31:45.499 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:31:46.142 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:31:47.289 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:31:49.645 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:31:49.645 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:31:50.163 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422705 status=200 resp_size=114384
|
||
2026-01-15 04:31:50.163 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:31:50.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768422710 status=200 resp_size=5029
|
||
2026-01-15 04:31:50.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422710&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:31:57.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768422716 status=200 resp_size=5184
|
||
2026-01-15 04:31:57.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422717&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 04:32:00.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768422719 status=200 resp_size=5579
|
||
2026-01-15 04:32:00.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422720&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 04:32:08.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768422727 status=200 resp_size=5000
|
||
2026-01-15 04:32:08.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422728&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 04:32:20.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768422738 status=200 resp_size=4954
|
||
2026-01-15 04:32:20.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422740&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 04:32:24.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768422743 status=200 resp_size=5630
|
||
2026-01-15 04:32:24.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422744&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 04:32:28.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768422748 status=200 resp_size=5546
|
||
2026-01-15 04:32:29.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422748&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 04:32:35.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768422754 status=200 resp_size=6579
|
||
2026-01-15 04:32:35.879 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422755&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 04:32:37.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768422756 status=200 resp_size=5976
|
||
2026-01-15 04:32:37.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422757&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 04:32:47.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768422767 status=200 resp_size=5739
|
||
2026-01-15 04:32:47.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422767&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 04:32:50.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768422770 status=200 resp_size=6192
|
||
2026-01-15 04:32:51.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422770&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 04:32:55.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768422774 status=200 resp_size=6139
|
||
2026-01-15 04:32:55.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422775&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 04:33:05.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768422784 status=200 resp_size=6399
|
||
2026-01-15 04:33:05.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422785&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:33:16.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768422795 status=200 resp_size=5813
|
||
2026-01-15 04:33:16.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422796&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 04:33:20.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768422799 status=200 resp_size=5890
|
||
2026-01-15 04:33:20.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422800&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:33:22.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768422802 status=200 resp_size=4892
|
||
2026-01-15 04:33:22.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422802&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 04:33:28.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768422807 status=200 resp_size=6179
|
||
2026-01-15 04:33:28.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422808&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 04:33:29.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768422809 status=200 resp_size=5431
|
||
2026-01-15 04:33:30.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422809&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 04:33:40.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768422819 status=200 resp_size=6023
|
||
2026-01-15 04:33:40.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422820&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:33:50.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768422829 status=200 resp_size=6048
|
||
2026-01-15 04:33:51.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422830&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:33:51.125 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:33:51.388 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:33:51.404 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 04:33:51.404 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 04:33:54.631 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.23 秒后继续...
|
||
2026-01-15 04:33:54.631 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 04:33:54.631 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:33:54.657 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:33:55.442 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:33:56.651 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:33:58.850 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:33:58.850 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:33:59.398 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422834 status=200 resp_size=108574
|
||
2026-01-15 04:33:59.398 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:33:59.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768422839 status=200 resp_size=6137
|
||
2026-01-15 04:33:59.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422839&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 04:34:09.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768422847 status=200 resp_size=6192
|
||
2026-01-15 04:34:09.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422849&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 04:34:17.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768422856 status=200 resp_size=5754
|
||
2026-01-15 04:34:17.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422857&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 04:34:24.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768422863 status=200 resp_size=5721
|
||
2026-01-15 04:34:24.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422864&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 04:34:29.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768422869 status=200 resp_size=6366
|
||
2026-01-15 04:34:30.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422869&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-15 04:34:36.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768422875 status=200 resp_size=7534
|
||
2026-01-15 04:34:36.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422876&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 04:34:46.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768422886 status=200 resp_size=6787
|
||
2026-01-15 04:34:47.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422886&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 04:34:50.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768422890 status=200 resp_size=5476
|
||
2026-01-15 04:34:51.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422890&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 04:34:54.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768422894 status=200 resp_size=6423
|
||
2026-01-15 04:34:54.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422894&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:35:04.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768422903 status=200 resp_size=5190
|
||
2026-01-15 04:35:04.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422904&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 04:35:13.445 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768422912 status=200 resp_size=6134
|
||
2026-01-15 04:35:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422913&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 04:35:17.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768422917 status=200 resp_size=5591
|
||
2026-01-15 04:35:17.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422917&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 04:35:22.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768422922 status=200 resp_size=4321
|
||
2026-01-15 04:35:22.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422922&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 04:35:26.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768422926 status=200 resp_size=5110
|
||
2026-01-15 04:35:26.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422926&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 04:35:36.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768422935 status=200 resp_size=5960
|
||
2026-01-15 04:35:36.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422936&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 04:35:39.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768422939 status=200 resp_size=5613
|
||
2026-01-15 04:35:39.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422939&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:35:42.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768422942 status=200 resp_size=5845
|
||
2026-01-15 04:36:12.292 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
|
||
2026-01-15 04:36:14.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422942&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:36:17.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768422977 status=200 resp_size=5374
|
||
2026-01-15 04:36:18.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422977&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:36:22.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768422982 status=200 resp_size=5478
|
||
2026-01-15 04:36:22.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422982&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 04:36:30.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768422989 status=200 resp_size=5603
|
||
2026-01-15 04:36:30.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768422990&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 04:36:30.235 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:36:30.501 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:36:30.501 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 04:36:39.953 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.45 秒后继续...
|
||
2026-01-15 04:36:39.953 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 04:36:39.953 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:36:39.972 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:36:40.648 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:36:41.825 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:36:44.010 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:36:44.010 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:36:44.623 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768422999 status=200 resp_size=113748
|
||
2026-01-15 04:36:44.623 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:36:44.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768423004 status=200 resp_size=5677
|
||
2026-01-15 04:36:45.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423004&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 04:36:51.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768423011 status=200 resp_size=5694
|
||
2026-01-15 04:36:52.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423011&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:36:56.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768423016 status=200 resp_size=5506
|
||
2026-01-15 04:36:57.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423016&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:37:04.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768423022 status=200 resp_size=6076
|
||
2026-01-15 04:37:05.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423024&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 04:37:06.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768423026 status=200 resp_size=7499
|
||
2026-01-15 04:37:06.908 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423026&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 04:37:17.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768423036 status=200 resp_size=5653
|
||
2026-01-15 04:37:17.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423037&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 04:37:19.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768423039 status=200 resp_size=5513
|
||
2026-01-15 04:37:19.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423039&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 04:37:29.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768423048 status=200 resp_size=6285
|
||
2026-01-15 04:37:29.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423049&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 04:37:35.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768423054 status=200 resp_size=8364
|
||
2026-01-15 04:37:35.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423055&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-15 04:37:43.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768423062 status=200 resp_size=5127
|
||
2026-01-15 04:37:43.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423063&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 04:37:49.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768423069 status=200 resp_size=5182
|
||
2026-01-15 04:37:49.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423069&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 04:37:56.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768423075 status=200 resp_size=5988
|
||
2026-01-15 04:37:56.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423076&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 04:37:58.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768423078 status=200 resp_size=5632
|
||
2026-01-15 04:37:58.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423078&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-15 04:38:06.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768423085 status=200 resp_size=5333
|
||
2026-01-15 04:38:06.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423086&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:38:14.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768423094 status=200 resp_size=5725
|
||
2026-01-15 04:38:15.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423094&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 04:38:22.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768423101 status=200 resp_size=5729
|
||
2026-01-15 04:38:22.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423102&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:38:24.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768423104 status=200 resp_size=6473
|
||
2026-01-15 04:38:24.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423104&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:38:27.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768423107 status=200 resp_size=5222
|
||
2026-01-15 04:38:27.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423107&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 04:38:30.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768423109 status=200 resp_size=5723
|
||
2026-01-15 04:38:30.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423110&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 04:38:37.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768423116 status=200 resp_size=6035
|
||
2026-01-15 04:38:37.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423117&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 04:38:37.556 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:38:43.236 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:38:43.236 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 04:38:45.675 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.43 秒后继续...
|
||
2026-01-15 04:38:45.675 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 04:38:45.675 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:38:45.703 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:38:46.429 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:38:47.588 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:38:49.788 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:38:49.788 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:38:50.321 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423125 status=200 resp_size=124670
|
||
2026-01-15 04:38:50.321 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:38:50.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768423130 status=200 resp_size=6718
|
||
2026-01-15 04:38:50.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423130&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 04:38:52.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768423132 status=200 resp_size=5245
|
||
2026-01-15 04:38:52.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423132&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 04:39:02.005 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768423141 status=200 resp_size=6651
|
||
2026-01-15 04:39:02.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423142&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 04:39:03.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768423143 status=200 resp_size=5833
|
||
2026-01-15 04:39:04.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423143&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:39:10.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768423149 status=200 resp_size=6573
|
||
2026-01-15 04:39:10.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423150&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 04:39:18.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768423157 status=200 resp_size=6448
|
||
2026-01-15 04:39:18.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423158&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 04:39:21.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768423161 status=200 resp_size=6466
|
||
2026-01-15 04:39:22.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423161&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:39:24.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768423164 status=200 resp_size=5793
|
||
2026-01-15 04:39:24.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423164&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:39:28.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768423167 status=200 resp_size=6715
|
||
2026-01-15 04:39:28.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423168&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 04:39:34.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768423173 status=200 resp_size=5803
|
||
2026-01-15 04:39:34.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423174&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:39:45.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768423184 status=200 resp_size=5961
|
||
2026-01-15 04:39:45.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423185&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:39:53.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768423192 status=200 resp_size=6392
|
||
2026-01-15 04:39:53.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423193&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 04:40:01.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768423200 status=200 resp_size=6024
|
||
2026-01-15 04:40:01.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423201&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:40:11.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768423211 status=200 resp_size=6049
|
||
2026-01-15 04:40:11.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423211&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:40:20.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768423220 status=200 resp_size=6511
|
||
2026-01-15 04:40:21.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423220&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 04:40:23.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768423222 status=200 resp_size=5940
|
||
2026-01-15 04:40:23.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423223&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:40:31.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768423231 status=200 resp_size=5699
|
||
2026-01-15 04:40:32.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423231&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 04:40:38.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768423237 status=200 resp_size=4058
|
||
2026-01-15 04:40:38.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423238&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 04:40:47.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768423246 status=200 resp_size=5232
|
||
2026-01-15 04:40:47.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423247&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:40:49.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768423249 status=200 resp_size=6177
|
||
2026-01-15 04:40:49.903 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423249&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 04:40:49.903 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:40:50.313 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:40:50.313 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 04:40:53.495 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
|
||
2026-01-15 04:40:53.495 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 04:40:53.495 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:40:53.517 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:40:54.167 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:40:55.329 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:40:57.474 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:40:57.474 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:40:57.977 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423253 status=200 resp_size=127911
|
||
2026-01-15 04:40:57.992 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:40:58.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768423257 status=200 resp_size=5857
|
||
2026-01-15 04:40:58.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423258&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 04:41:07.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768423266 status=200 resp_size=5634
|
||
2026-01-15 04:41:07.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423267&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:41:16.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768423276 status=200 resp_size=6125
|
||
2026-01-15 04:41:17.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423276&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:41:24.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768423283 status=200 resp_size=5888
|
||
2026-01-15 04:41:24.314 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423284&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 04:41:27.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768423287 status=200 resp_size=5942
|
||
2026-01-15 04:41:27.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423287&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 04:41:33.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768423293 status=200 resp_size=6055
|
||
2026-01-15 04:41:33.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423293&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 04:41:40.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768423299 status=200 resp_size=5455
|
||
2026-01-15 04:41:40.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423300&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 04:41:42.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768423302 status=200 resp_size=6314
|
||
2026-01-15 04:41:42.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423302&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 04:41:46.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768423306 status=200 resp_size=5687
|
||
2026-01-15 04:41:47.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423306&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:41:57.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768423316 status=200 resp_size=5638
|
||
2026-01-15 04:41:57.453 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423317&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 04:42:00.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768423319 status=200 resp_size=8574
|
||
2026-01-15 04:42:00.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423320&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 04:42:10.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768423329 status=200 resp_size=7551
|
||
2026-01-15 04:42:10.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423330&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 04:42:12.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768423331 status=200 resp_size=5784
|
||
2026-01-15 04:42:12.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423332&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 04:42:22.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768423341 status=200 resp_size=6552
|
||
2026-01-15 04:42:22.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423342&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:42:26.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768423346 status=200 resp_size=5306
|
||
2026-01-15 04:42:26.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423346&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 04:42:31.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768423351 status=200 resp_size=7182
|
||
2026-01-15 04:42:31.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423351&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 04:42:33.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768423352 status=200 resp_size=5407
|
||
2026-01-15 04:42:33.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423353&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 04:42:35.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768423354 status=200 resp_size=5497
|
||
2026-01-15 04:42:35.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423355&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:42:42.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768423361 status=200 resp_size=6343
|
||
2026-01-15 04:42:42.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423362&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 04:42:50.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768423369 status=200 resp_size=5655
|
||
2026-01-15 04:42:50.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423370&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 04:42:50.646 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:42:56.865 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:42:56.865 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 04:43:03.393 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.52 秒后继续...
|
||
2026-01-15 04:43:03.393 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 04:43:03.393 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:43:03.413 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:43:04.167 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:43:05.346 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:43:07.514 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:43:07.514 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:43:08.032 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423383 status=200 resp_size=146035
|
||
2026-01-15 04:43:08.032 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:43:08.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768423388 status=200 resp_size=8235
|
||
2026-01-15 04:43:08.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423388&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 04:43:10.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768423390 status=200 resp_size=6689
|
||
2026-01-15 04:43:11.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423390&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:43:15.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768423395 status=200 resp_size=7119
|
||
2026-01-15 04:43:16.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423395&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 04:43:24.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768423403 status=200 resp_size=5615
|
||
2026-01-15 04:43:24.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423404&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 04:43:34.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768423413 status=200 resp_size=6714
|
||
2026-01-15 04:43:34.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423414&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 04:43:39.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768423419 status=200 resp_size=6390
|
||
2026-01-15 04:43:40.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423419&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:43:46.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768423425 status=200 resp_size=5775
|
||
2026-01-15 04:43:47.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423426&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 04:43:49.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768423429 status=200 resp_size=6696
|
||
2026-01-15 04:43:49.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423429&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 04:43:55.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768423434 status=200 resp_size=13102
|
||
2026-01-15 04:43:55.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423435&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 04:44:01.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768423440 status=200 resp_size=6230
|
||
2026-01-15 04:44:01.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:44:09.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768423448 status=200 resp_size=5128
|
||
2026-01-15 04:44:09.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423449&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 04:44:19.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768423458 status=200 resp_size=6362
|
||
2026-01-15 04:44:19.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423459&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 04:44:27.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768423466 status=200 resp_size=6527
|
||
2026-01-15 04:44:27.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423467&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 04:44:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768423471 status=200 resp_size=8808
|
||
2026-01-15 04:44:32.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423472&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:44:38.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768423478 status=200 resp_size=7130
|
||
2026-01-15 04:44:38.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423478&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 04:44:48.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768423487 status=200 resp_size=7415
|
||
2026-01-15 04:44:48.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423488&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 04:44:50.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768423490 status=200 resp_size=5152
|
||
2026-01-15 04:44:50.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423490&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 04:44:59.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768423498 status=200 resp_size=5920
|
||
2026-01-15 04:44:59.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423499&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:45:02.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768423502 status=200 resp_size=5877
|
||
2026-01-15 04:45:02.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423502&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 04:45:05.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768423505 status=200 resp_size=5098
|
||
2026-01-15 04:45:05.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423505&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 04:45:05.586 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:45:12.154 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:45:12.154 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 04:45:16.957 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.79 秒后继续...
|
||
2026-01-15 04:45:16.957 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 04:45:16.957 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:45:16.976 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:45:17.730 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:45:18.907 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:45:21.088 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:45:21.088 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:45:21.638 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423516 status=200 resp_size=147497
|
||
2026-01-15 04:45:21.638 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:45:21.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768423521 status=200 resp_size=6970
|
||
2026-01-15 04:45:22.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423521&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 04:45:30.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768423529 status=200 resp_size=6445
|
||
2026-01-15 04:45:31.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:45:34.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768423534 status=200 resp_size=7717
|
||
2026-01-15 04:45:35.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423534&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 04:45:42.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768423541 status=200 resp_size=5109
|
||
2026-01-15 04:45:42.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423542&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 04:45:51.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768423550 status=200 resp_size=8734
|
||
2026-01-15 04:45:51.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423551&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 04:45:54.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768423554 status=200 resp_size=6501
|
||
2026-01-15 04:45:54.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423554&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:45:56.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768423556 status=200 resp_size=5533
|
||
2026-01-15 04:45:56.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423556&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 04:46:04.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768423563 status=200 resp_size=5524
|
||
2026-01-15 04:46:04.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423564&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 04:46:07.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768423567 status=200 resp_size=6522
|
||
2026-01-15 04:46:08.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423567&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 04:46:16.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768423575 status=200 resp_size=5756
|
||
2026-01-15 04:46:16.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423576&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:46:26.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768423585 status=200 resp_size=7756
|
||
2026-01-15 04:46:26.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423586&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 04:46:32.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768423591 status=200 resp_size=6318
|
||
2026-01-15 04:46:32.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423592&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 04:46:41.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768423600 status=200 resp_size=7311
|
||
2026-01-15 04:46:41.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423601&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-15 04:46:48.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768423607 status=200 resp_size=5678
|
||
2026-01-15 04:46:48.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423608&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:46:51.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768423611 status=200 resp_size=5458
|
||
2026-01-15 04:46:51.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423611&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 04:47:00.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768423619 status=200 resp_size=7237
|
||
2026-01-15 04:47:00.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423620&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 04:47:03.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768423623 status=200 resp_size=5342
|
||
2026-01-15 04:47:04.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423623&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 04:47:14.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768423633 status=200 resp_size=8457
|
||
2026-01-15 04:47:14.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423634&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:47:22.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768423641 status=200 resp_size=6431
|
||
2026-01-15 04:47:22.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423642&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 04:47:30.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768423650 status=200 resp_size=6416
|
||
2026-01-15 04:47:30.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423650&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 04:47:30.994 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:47:37.338 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:47:37.354 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 04:47:43.671 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.31 秒后继续...
|
||
2026-01-15 04:47:43.671 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 04:47:43.671 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:47:43.698 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:47:44.491 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:47:45.678 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:47:47.876 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:47:47.876 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:47:48.425 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423663 status=200 resp_size=151950
|
||
2026-01-15 04:47:48.425 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:47:48.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768423668 status=200 resp_size=5876
|
||
2026-01-15 04:47:48.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423668&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 04:47:52.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768423672 status=200 resp_size=5974
|
||
2026-01-15 04:47:52.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423672&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:48:03.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768423682 status=200 resp_size=6646
|
||
2026-01-15 04:48:03.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423683&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 04:48:11.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768423690 status=200 resp_size=6958
|
||
2026-01-15 04:48:11.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423691&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:48:13.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768423693 status=200 resp_size=5506
|
||
2026-01-15 04:48:13.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423693&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 04:48:18.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768423698 status=200 resp_size=6449
|
||
2026-01-15 04:48:18.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423698&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 04:48:26.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768423705 status=200 resp_size=6015
|
||
2026-01-15 04:48:26.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423706&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-15 04:48:29.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768423709 status=200 resp_size=6511
|
||
2026-01-15 04:48:29.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423709&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:48:38.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768423717 status=200 resp_size=5925
|
||
2026-01-15 04:48:38.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423718&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 04:48:44.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768423724 status=200 resp_size=7750
|
||
2026-01-15 04:48:45.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423724&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 04:48:55.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768423734 status=200 resp_size=7971
|
||
2026-01-15 04:48:55.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423735&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 04:49:02.361 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768423741 status=200 resp_size=6119
|
||
2026-01-15 04:49:02.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423742&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:49:03.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768423743 status=200 resp_size=8313
|
||
2026-01-15 04:49:04.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423743&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 04:49:09.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768423748 status=200 resp_size=5424
|
||
2026-01-15 04:49:09.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423749&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 04:49:10.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768423750 status=200 resp_size=8274
|
||
2026-01-15 04:49:10.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423750&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 04:49:21.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768423760 status=200 resp_size=6058
|
||
2026-01-15 04:49:21.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423761&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:49:26.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768423766 status=200 resp_size=8701
|
||
2026-01-15 04:49:26.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423766&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 04:49:32.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768423771 status=200 resp_size=5211
|
||
2026-01-15 04:49:33.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423772&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 04:49:41.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768423780 status=200 resp_size=5378
|
||
2026-01-15 04:49:41.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423781&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 04:49:46.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768423785 status=200 resp_size=6284
|
||
2026-01-15 04:49:46.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423786&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:49:46.488 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:49:53.183 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:49:53.183 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 04:49:55.924 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.73 秒后继续...
|
||
2026-01-15 04:49:55.924 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 04:49:55.924 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:49:55.945 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:49:56.683 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:49:57.860 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:50:00.043 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:50:00.043 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:50:00.546 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423795 status=200 resp_size=150966
|
||
2026-01-15 04:50:00.546 | WARNING | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 04:50:00.546 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:50:00.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768423800 status=200 resp_size=7299
|
||
2026-01-15 04:50:00.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423800&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 04:50:10.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768423809 status=200 resp_size=7262
|
||
2026-01-15 04:50:10.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423810&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 04:50:14.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768423813 status=200 resp_size=6254
|
||
2026-01-15 04:50:14.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423814&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:50:16.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768423815 status=200 resp_size=7967
|
||
2026-01-15 04:50:16.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423816&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 04:50:18.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768423817 status=200 resp_size=5253
|
||
2026-01-15 04:50:18.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423818&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 04:50:22.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768423821 status=200 resp_size=5431
|
||
2026-01-15 04:50:22.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423822&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 04:50:26.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768423825 status=200 resp_size=4995
|
||
2026-01-15 04:50:26.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423826&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:50:32.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768423831 status=200 resp_size=6080
|
||
2026-01-15 04:50:32.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423832&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 04:50:37.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768423837 status=200 resp_size=5936
|
||
2026-01-15 04:50:37.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423837&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 04:50:40.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768423839 status=200 resp_size=6041
|
||
2026-01-15 04:50:40.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423840&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 04:50:46.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768423845 status=200 resp_size=4916
|
||
2026-01-15 04:50:47.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423846&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 04:50:53.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768423852 status=200 resp_size=5446
|
||
2026-01-15 04:50:53.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423853&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-15 04:50:55.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768423855 status=200 resp_size=6494
|
||
2026-01-15 04:50:55.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423855&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 04:51:03.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768423862 status=200 resp_size=5860
|
||
2026-01-15 04:51:04.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423863&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:51:13.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768423872 status=200 resp_size=6226
|
||
2026-01-15 04:51:13.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423873&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 04:51:18.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768423878 status=200 resp_size=5613
|
||
2026-01-15 04:51:19.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423878&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 04:51:21.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768423881 status=200 resp_size=6422
|
||
2026-01-15 04:51:22.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423881&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 04:51:30.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768423889 status=200 resp_size=5792
|
||
2026-01-15 04:51:30.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423890&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:51:37.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768423896 status=200 resp_size=6176
|
||
2026-01-15 04:51:37.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423897&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 04:51:37.393 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 04:51:43.581 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 04:51:43.581 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 04:51:46.974 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.39 秒后继续...
|
||
2026-01-15 04:51:46.974 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 04:51:46.974 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:51:46.989 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:51:47.633 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:51:48.779 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:51:50.915 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:51:50.915 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:51:51.465 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768423906 status=200 resp_size=147503
|
||
2026-01-15 04:51:51.465 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 04:51:51.465 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:51:51.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768423911 status=200 resp_size=7607
|
||
2026-01-15 04:51:51.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423911&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 04:52:00.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768423919 status=200 resp_size=6731
|
||
2026-01-15 04:52:00.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423920&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 04:52:07.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768423926 status=200 resp_size=5575
|
||
2026-01-15 04:52:07.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423927&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 04:52:15.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768423934 status=200 resp_size=5711
|
||
2026-01-15 04:52:16.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423935&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 04:52:21.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768423940 status=200 resp_size=6856
|
||
2026-01-15 04:52:21.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423941&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 04:52:27.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768423946 status=200 resp_size=5731
|
||
2026-01-15 04:52:27.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423947&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 04:52:33.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768423953 status=200 resp_size=7075
|
||
2026-01-15 04:52:33.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423953&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 04:52:36.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768423956 status=200 resp_size=6768
|
||
2026-01-15 04:52:36.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423956&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:52:41.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768423961 status=200 resp_size=6530
|
||
2026-01-15 04:52:41.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423961&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:52:46.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768423966 status=200 resp_size=8973
|
||
2026-01-15 04:52:46.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423966&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 04:52:48.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768423968 status=200 resp_size=6315
|
||
2026-01-15 04:52:48.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423968&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 04:52:56.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768423975 status=200 resp_size=8559
|
||
2026-01-15 04:52:56.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423976&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 04:53:03.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768423983 status=200 resp_size=6688
|
||
2026-01-15 04:53:04.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423983&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 04:53:12.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768423991 status=200 resp_size=5290
|
||
2026-01-15 04:53:12.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423992&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 04:53:16.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768423996 status=200 resp_size=5982
|
||
2026-01-15 04:53:16.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423996&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 04:53:19.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768423999 status=200 resp_size=7919
|
||
2026-01-15 04:53:19.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768423999&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 04:53:24.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768424004 status=200 resp_size=7681
|
||
2026-01-15 04:53:24.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424004&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 04:53:33.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768424013 status=200 resp_size=5271
|
||
2026-01-15 04:53:33.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424013&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 04:53:41.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768424021 status=200 resp_size=7124
|
||
2026-01-15 04:53:42.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424021&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:53:42.136 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 04:53:48.119 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 04:53:48.119 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 04:53:51.245 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.12 秒后继续...
|
||
2026-01-15 04:53:51.245 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 04:53:51.245 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:53:51.261 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:53:53.285 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:53:54.448 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:53:56.615 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:53:56.615 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:53:57.144 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424031 status=200 resp_size=129568
|
||
2026-01-15 04:53:57.144 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:53:57.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768424037 status=200 resp_size=5686
|
||
2026-01-15 04:53:57.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424037&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-15 04:54:04.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768424043 status=200 resp_size=6660
|
||
2026-01-15 04:54:04.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424044&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 04:54:08.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768424048 status=200 resp_size=7952
|
||
2026-01-15 04:54:08.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424048&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 04:54:11.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768424051 status=200 resp_size=5414
|
||
2026-01-15 04:54:11.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424051&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:54:19.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768424058 status=200 resp_size=5277
|
||
2026-01-15 04:54:19.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424059&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 04:54:29.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768424068 status=200 resp_size=7175
|
||
2026-01-15 04:54:29.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424069&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 04:54:39.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768424078 status=200 resp_size=6284
|
||
2026-01-15 04:54:39.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424079&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:54:48.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768424087 status=200 resp_size=5673
|
||
2026-01-15 04:54:48.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424088&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 04:54:52.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768424091 status=200 resp_size=6168
|
||
2026-01-15 04:54:52.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424092&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 04:54:59.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768424098 status=200 resp_size=5943
|
||
2026-01-15 04:54:59.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424099&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 04:55:05.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768424104 status=200 resp_size=5924
|
||
2026-01-15 04:55:05.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424105&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 04:55:13.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768424112 status=200 resp_size=6003
|
||
2026-01-15 04:55:13.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424113&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 04:55:15.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768424115 status=200 resp_size=5378
|
||
2026-01-15 04:55:15.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424115&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 04:55:18.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768424118 status=200 resp_size=5084
|
||
2026-01-15 04:55:19.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424118&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:55:21.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768424121 status=200 resp_size=4913
|
||
2026-01-15 04:55:21.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424121&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 04:55:26.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768424125 status=200 resp_size=9486
|
||
2026-01-15 04:55:26.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424126&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 04:55:30.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768424130 status=200 resp_size=5363
|
||
2026-01-15 04:55:30.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424130&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 04:55:38.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768424137 status=200 resp_size=13285
|
||
2026-01-15 04:55:38.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424138&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 04:55:46.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768424146 status=200 resp_size=6873
|
||
2026-01-15 04:55:46.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424146&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:55:56.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768424155 status=200 resp_size=6041
|
||
2026-01-15 04:55:56.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424156&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 04:55:56.508 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:55:56.913 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:55:56.913 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 04:56:02.849 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.93 秒后继续...
|
||
2026-01-15 04:56:02.850 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 04:56:02.850 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:56:02.866 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:56:03.368 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:56:04.533 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:56:06.667 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:56:06.667 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:56:07.107 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424162 status=200 resp_size=129499
|
||
2026-01-15 04:56:07.122 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:56:07.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768424167 status=200 resp_size=6635
|
||
2026-01-15 04:56:07.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424167&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 04:56:11.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768424171 status=200 resp_size=6205
|
||
2026-01-15 04:56:13.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424171&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 04:56:22.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768424181 status=200 resp_size=5390
|
||
2026-01-15 04:56:22.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424182&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 04:56:31.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768424190 status=200 resp_size=8070
|
||
2026-01-15 04:56:31.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424191&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 04:56:40.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768424199 status=200 resp_size=6588
|
||
2026-01-15 04:56:40.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424200&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 04:56:45.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768424205 status=200 resp_size=6300
|
||
2026-01-15 04:56:45.459 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424205&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 04:56:51.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768424210 status=200 resp_size=7194
|
||
2026-01-15 04:56:51.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424211&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 04:56:55.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768424215 status=200 resp_size=6053
|
||
2026-01-15 04:56:55.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424215&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 04:57:03.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768424223 status=200 resp_size=7170
|
||
2026-01-15 04:57:04.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424223&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:57:11.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768424230 status=200 resp_size=4992
|
||
2026-01-15 04:57:11.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424231&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 04:57:20.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768424239 status=200 resp_size=6073
|
||
2026-01-15 04:57:20.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424240&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:57:28.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768424248 status=200 resp_size=7194
|
||
2026-01-15 04:57:29.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424248&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 04:57:31.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768424251 status=200 resp_size=6770
|
||
2026-01-15 04:57:31.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424251&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:57:34.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768424254 status=200 resp_size=5344
|
||
2026-01-15 04:57:34.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424254&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 04:57:42.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768424261 status=200 resp_size=5554
|
||
2026-01-15 04:57:42.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424262&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:57:52.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768424272 status=200 resp_size=5280
|
||
2026-01-15 04:57:53.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424272&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 04:57:54.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768424274 status=200 resp_size=5040
|
||
2026-01-15 04:57:54.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424274&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 04:57:57.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768424277 status=200 resp_size=4993
|
||
2026-01-15 04:57:57.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424277&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 04:57:59.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768424279 status=200 resp_size=6752
|
||
2026-01-15 04:58:00.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424279&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:58:03.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768424283 status=200 resp_size=5883
|
||
2026-01-15 04:58:03.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424283&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 04:58:03.914 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 04:58:09.917 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 04:58:09.917 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 04:58:16.853 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.92 秒后继续...
|
||
2026-01-15 04:58:16.853 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 04:58:16.853 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 04:58:16.876 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 04:58:17.442 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:58:18.573 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:58:20.756 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 04:58:20.756 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 04:58:21.337 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424296 status=200 resp_size=142962
|
||
2026-01-15 04:58:21.337 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 04:58:21.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768424301 status=200 resp_size=5688
|
||
2026-01-15 04:58:21.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424301&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 04:58:23.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768424303 status=200 resp_size=6980
|
||
2026-01-15 04:58:23.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424303&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 04:58:30.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768424310 status=200 resp_size=6794
|
||
2026-01-15 04:58:31.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424310&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 04:58:32.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768424312 status=200 resp_size=5283
|
||
2026-01-15 04:58:32.947 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424312&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 04:58:37.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768424317 status=200 resp_size=5215
|
||
2026-01-15 04:58:37.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424317&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 04:58:44.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768424323 status=200 resp_size=5764
|
||
2026-01-15 04:58:44.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424324&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 04:58:51.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768424330 status=200 resp_size=5516
|
||
2026-01-15 04:58:51.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424331&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 04:58:59.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768424338 status=200 resp_size=6659
|
||
2026-01-15 04:58:59.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424339&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 04:59:10.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768424349 status=200 resp_size=5165
|
||
2026-01-15 04:59:10.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424350&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 04:59:16.937 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768424356 status=200 resp_size=6856
|
||
2026-01-15 04:59:17.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424356&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 04:59:21.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768424361 status=200 resp_size=5570
|
||
2026-01-15 04:59:21.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424361&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 04:59:26.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768424366 status=200 resp_size=6749
|
||
2026-01-15 04:59:26.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424366&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 04:59:29.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768424369 status=200 resp_size=5688
|
||
2026-01-15 04:59:30.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424369&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 04:59:32.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768424372 status=200 resp_size=6380
|
||
2026-01-15 04:59:32.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424372&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 04:59:36.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768424376 status=200 resp_size=7975
|
||
2026-01-15 04:59:36.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424376&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 04:59:46.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768424385 status=200 resp_size=5984
|
||
2026-01-15 04:59:46.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424386&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 04:59:57.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768424395 status=200 resp_size=7270
|
||
2026-01-15 04:59:57.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424397&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 05:00:00.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768424400 status=200 resp_size=5582
|
||
2026-01-15 05:00:00.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424400&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 05:00:09.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768424408 status=200 resp_size=5924
|
||
2026-01-15 05:00:09.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424409&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 05:00:12.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768424410 status=200 resp_size=6027
|
||
2026-01-15 05:00:12.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424412&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 05:00:12.258 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:00:22.618 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:00:22.618 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 05:00:28.554 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.93 秒后继续...
|
||
2026-01-15 05:00:28.554 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 05:00:28.554 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:00:28.577 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:00:29.127 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:00:30.260 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:00:32.382 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:00:32.382 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:00:32.853 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424428 status=200 resp_size=163507
|
||
2026-01-15 05:00:32.853 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:00:33.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768424432 status=200 resp_size=6028
|
||
2026-01-15 05:00:33.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424433&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:00:39.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768424438 status=200 resp_size=4774
|
||
2026-01-15 05:00:39.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424439&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 05:00:47.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768424444 status=200 resp_size=8782
|
||
2026-01-15 05:00:49.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424447&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 05:00:51.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768424451 status=200 resp_size=8655
|
||
2026-01-15 05:00:51.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424451&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 05:00:52.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768424452 status=200 resp_size=6935
|
||
2026-01-15 05:00:52.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424452&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 05:00:55.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768424455 status=200 resp_size=6440
|
||
2026-01-15 05:00:55.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424455&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 05:01:04.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768424463 status=200 resp_size=7907
|
||
2026-01-15 05:01:04.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424464&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 05:01:07.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768424467 status=200 resp_size=4592
|
||
2026-01-15 05:01:07.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424467&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 05:01:10.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768424470 status=200 resp_size=5878
|
||
2026-01-15 05:01:11.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424470&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:01:17.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768424476 status=200 resp_size=6437
|
||
2026-01-15 05:01:18.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424477&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 05:01:26.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768424486 status=200 resp_size=5672
|
||
2026-01-15 05:01:26.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424486&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 05:01:30.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768424489 status=200 resp_size=5463
|
||
2026-01-15 05:01:30.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424490&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 05:01:37.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768424497 status=200 resp_size=5448
|
||
2026-01-15 05:01:37.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424497&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:01:46.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768424505 status=200 resp_size=9108
|
||
2026-01-15 05:01:46.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424506&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 05:01:55.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768424513 status=200 resp_size=6111
|
||
2026-01-15 05:01:55.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424515&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 05:02:03.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768424523 status=200 resp_size=6612
|
||
2026-01-15 05:02:04.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424523&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 05:02:11.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768424529 status=200 resp_size=7313
|
||
2026-01-15 05:02:12.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424531&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 05:02:21.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768424540 status=200 resp_size=6958
|
||
2026-01-15 05:02:21.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424541&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 05:02:29.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768424548 status=200 resp_size=6694
|
||
2026-01-15 05:02:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424549&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 05:02:40.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768424559 status=200 resp_size=6568
|
||
2026-01-15 05:02:40.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424560&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 05:02:40.541 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:02:47.074 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:02:47.074 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 05:02:52.120 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.03 秒后继续...
|
||
2026-01-15 05:02:52.120 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 05:02:52.120 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:02:52.147 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:02:52.696 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:02:53.828 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:02:55.948 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:02:55.948 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:02:56.403 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424572 status=200 resp_size=128123
|
||
2026-01-15 05:02:56.403 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:02:56.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768424576 status=200 resp_size=5922
|
||
2026-01-15 05:02:56.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424576&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 05:03:03.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768424582 status=200 resp_size=5499
|
||
2026-01-15 05:03:03.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424583&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-15 05:03:10.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768424589 status=200 resp_size=6184
|
||
2026-01-15 05:03:10.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424590&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-15 05:03:15.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768424594 status=200 resp_size=5673
|
||
2026-01-15 05:03:15.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424595&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-15 05:03:18.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768424598 status=200 resp_size=7081
|
||
2026-01-15 05:03:18.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424598&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 05:03:26.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768424605 status=200 resp_size=7664
|
||
2026-01-15 05:03:26.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424606&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 05:03:28.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768424608 status=200 resp_size=6652
|
||
2026-01-15 05:03:28.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424608&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-15 05:03:33.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768424613 status=200 resp_size=4733
|
||
2026-01-15 05:03:34.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424613&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:03:45.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768424623 status=200 resp_size=4926
|
||
2026-01-15 05:03:45.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424625&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 05:03:51.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768424631 status=200 resp_size=4906
|
||
2026-01-15 05:03:51.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424631&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 05:03:56.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768424636 status=200 resp_size=7369
|
||
2026-01-15 05:03:56.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424636&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 05:04:00.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768424640 status=200 resp_size=4834
|
||
2026-01-15 05:04:00.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424640&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:04:05.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768424645 status=200 resp_size=5006
|
||
2026-01-15 05:04:05.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424645&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-15 05:04:09.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768424647 status=200 resp_size=5363
|
||
2026-01-15 05:04:09.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424649&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-15 05:04:16.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768424656 status=200 resp_size=5232
|
||
2026-01-15 05:04:17.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424656&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-15 05:04:21.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086406?api_key=51job×tamp=1768424661 status=200 resp_size=6946
|
||
2026-01-15 05:04:21.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424661&companyId=9906597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3277
|
||
2026-01-15 05:04:26.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768424666 status=200 resp_size=4956
|
||
2026-01-15 05:04:26.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424666&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:04:30.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768424669 status=200 resp_size=7382
|
||
2026-01-15 05:04:30.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424670&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 05:04:33.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768424673 status=200 resp_size=7331
|
||
2026-01-15 05:04:33.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424673&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 05:04:37.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768424677 status=200 resp_size=6551
|
||
2026-01-15 05:04:37.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424677&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-15 05:04:37.977 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:04:43.770 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:04:43.770 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-15 05:04:47.917 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.13 秒后继续...
|
||
2026-01-15 05:04:47.917 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-15 05:04:47.917 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:04:47.948 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:04:48.528 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:04:49.674 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:04:51.810 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:04:51.810 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:04:52.336 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424687 status=200 resp_size=136175
|
||
2026-01-15 05:04:52.336 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:04:52.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768424692 status=200 resp_size=4515
|
||
2026-01-15 05:04:52.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424692&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-15 05:05:01.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768424699 status=200 resp_size=4865
|
||
2026-01-15 05:05:02.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424701&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-15 05:05:11.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768424710 status=200 resp_size=5241
|
||
2026-01-15 05:05:11.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424711&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-15 05:05:15.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169916147?api_key=51job×tamp=1768424714 status=200 resp_size=5494
|
||
2026-01-15 05:05:15.382 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424715&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 05:05:16.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768424716 status=200 resp_size=5087
|
||
2026-01-15 05:05:17.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424716&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-15 05:05:21.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768424720 status=200 resp_size=6572
|
||
2026-01-15 05:05:21.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424721&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-15 05:05:24.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877534?api_key=51job×tamp=1768424724 status=200 resp_size=6576
|
||
2026-01-15 05:05:25.166 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424724&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 05:05:28.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768424728 status=200 resp_size=5674
|
||
2026-01-15 05:05:28.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424728&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:05:35.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768424734 status=200 resp_size=6139
|
||
2026-01-15 05:05:35.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424735&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-15 05:05:40.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768424740 status=200 resp_size=5471
|
||
2026-01-15 05:05:40.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424740&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 05:05:50.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job×tamp=1768424750 status=200 resp_size=5725
|
||
2026-01-15 05:05:51.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424750&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
|
||
2026-01-15 05:05:56.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165105?api_key=51job×tamp=1768424756 status=200 resp_size=4737
|
||
2026-01-15 05:05:56.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424756&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 05:06:06.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160900397?api_key=51job×tamp=1768424766 status=200 resp_size=4297
|
||
2026-01-15 05:06:06.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424766&companyId=5028678&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10052
|
||
2026-01-15 05:06:15.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768424774 status=200 resp_size=5259
|
||
2026-01-15 05:06:15.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424775&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-15 05:06:21.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job×tamp=1768424781 status=200 resp_size=4786
|
||
2026-01-15 05:06:21.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424781&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 05:06:30.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job×tamp=1768424789 status=200 resp_size=5746
|
||
2026-01-15 05:06:30.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424790&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:06:36.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job×tamp=1768424795 status=200 resp_size=5466
|
||
2026-01-15 05:06:36.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424796&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 05:06:46.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161457255?api_key=51job×tamp=1768424805 status=200 resp_size=5037
|
||
2026-01-15 05:06:46.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424806&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 05:06:53.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165586496?api_key=51job×tamp=1768424811 status=200 resp_size=5631
|
||
2026-01-15 05:06:54.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424813&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 05:06:59.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168886308?api_key=51job×tamp=1768424819 status=200 resp_size=5979
|
||
2026-01-15 05:07:00.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424819&companyId=9458081&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6097
|
||
2026-01-15 05:07:00.138 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:07:06.013 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:07:06.028 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
|
||
2026-01-15 05:07:07.657 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.63 秒后继续...
|
||
2026-01-15 05:07:07.657 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 17/26 页...
|
||
2026-01-15 05:07:07.657 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:07:07.676 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:07:08.304 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:07:09.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:07:11.980 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:07:11.980 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:07:12.577 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424827 status=200 resp_size=132460
|
||
2026-01-15 05:07:12.577 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:07:12.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768424832 status=200 resp_size=6291
|
||
2026-01-15 05:07:13.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424832&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-15 05:07:18.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166505184?api_key=51job×tamp=1768424837 status=200 resp_size=4425
|
||
2026-01-15 05:07:18.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424838&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:07:25.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job×tamp=1768424844 status=200 resp_size=5928
|
||
2026-01-15 05:07:25.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424845&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 05:07:28.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job×tamp=1768424847 status=200 resp_size=5973
|
||
2026-01-15 05:07:28.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424848&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
|
||
2026-01-15 05:07:37.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job×tamp=1768424856 status=200 resp_size=4719
|
||
2026-01-15 05:07:37.532 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424857&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
|
||
2026-01-15 05:07:39.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job×tamp=1768424859 status=200 resp_size=6295
|
||
2026-01-15 05:07:40.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424859&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
|
||
2026-01-15 05:07:42.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142083639?api_key=51job×tamp=1768424861 status=200 resp_size=5806
|
||
2026-01-15 05:07:42.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424862&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:07:52.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job×tamp=1768424872 status=200 resp_size=5174
|
||
2026-01-15 05:07:52.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424872&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
|
||
2026-01-15 05:07:59.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job×tamp=1768424878 status=200 resp_size=6666
|
||
2026-01-15 05:07:59.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424879&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 05:08:02.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job×tamp=1768424882 status=200 resp_size=4654
|
||
2026-01-15 05:08:02.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424882&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
|
||
2026-01-15 05:08:12.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job×tamp=1768424891 status=200 resp_size=7248
|
||
2026-01-15 05:08:12.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424892&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 05:08:21.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169877882?api_key=51job×tamp=1768424901 status=200 resp_size=6546
|
||
2026-01-15 05:08:22.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424901&companyId=9484543&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8101
|
||
2026-01-15 05:08:25.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job×tamp=1768424905 status=200 resp_size=6546
|
||
2026-01-15 05:08:25.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424905&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
|
||
2026-01-15 05:08:33.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job×tamp=1768424912 status=200 resp_size=4679
|
||
2026-01-15 05:08:33.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424913&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
|
||
2026-01-15 05:08:36.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job×tamp=1768424915 status=200 resp_size=4783
|
||
2026-01-15 05:08:36.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424916&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-15 05:08:41.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job×tamp=1768424921 status=200 resp_size=5359
|
||
2026-01-15 05:08:42.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:08:46.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job×tamp=1768424926 status=200 resp_size=6326
|
||
2026-01-15 05:08:47.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424926&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 05:08:57.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160891426?api_key=51job×tamp=1768424936 status=200 resp_size=5325
|
||
2026-01-15 05:08:57.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424937&companyId=6853152&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7780
|
||
2026-01-15 05:09:04.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job×tamp=1768424943 status=200 resp_size=5106
|
||
2026-01-15 05:09:05.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424944&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7330
|
||
2026-01-15 05:09:11.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163235083?api_key=51job×tamp=1768424949 status=200 resp_size=4572
|
||
2026-01-15 05:09:11.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424951&companyId=6129765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2690
|
||
2026-01-15 05:09:11.482 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:09:21.300 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:09:21.316 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
|
||
2026-01-15 05:09:27.357 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.04 秒后继续...
|
||
2026-01-15 05:09:27.357 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 18/26 页...
|
||
2026-01-15 05:09:27.357 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:09:27.386 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:09:27.959 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:09:29.105 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:09:31.224 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:09:31.224 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:09:31.679 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768424967 status=200 resp_size=127562
|
||
2026-01-15 05:09:31.679 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:09:31.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157404678?api_key=51job×tamp=1768424971 status=200 resp_size=6325
|
||
2026-01-15 05:09:32.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424971&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 05:09:41.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768424981 status=200 resp_size=6303
|
||
2026-01-15 05:09:42.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424981&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-15 05:09:46.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job×tamp=1768424985 status=200 resp_size=5306
|
||
2026-01-15 05:09:46.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424986&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
|
||
2026-01-15 05:09:53.264 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job×tamp=1768424992 status=200 resp_size=6073
|
||
2026-01-15 05:09:53.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768424993&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
|
||
2026-01-15 05:10:04.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job×tamp=1768425003 status=200 resp_size=5111
|
||
2026-01-15 05:10:04.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425004&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 05:10:13.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163300238?api_key=51job×tamp=1768425013 status=200 resp_size=5915
|
||
2026-01-15 05:10:14.035 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425013&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 05:10:20.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job×tamp=1768425019 status=200 resp_size=5282
|
||
2026-01-15 05:10:20.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425020&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 05:10:22.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job×tamp=1768425022 status=200 resp_size=7778
|
||
2026-01-15 05:10:22.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425022&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 05:10:30.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169888660?api_key=51job×tamp=1768425030 status=200 resp_size=5294
|
||
2026-01-15 05:10:32.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425030&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:10:38.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002153?api_key=51job×tamp=1768425037 status=200 resp_size=7744
|
||
2026-01-15 05:10:38.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425038&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 05:10:49.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job×tamp=1768425048 status=200 resp_size=4757
|
||
2026-01-15 05:10:49.567 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425049&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
|
||
2026-01-15 05:10:50.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859226?api_key=51job×tamp=1768425050 status=200 resp_size=5693
|
||
2026-01-15 05:10:51.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425050&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:10:54.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job×tamp=1768425054 status=200 resp_size=5853
|
||
2026-01-15 05:10:54.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425054&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 05:11:02.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job×tamp=1768425062 status=200 resp_size=5360
|
||
2026-01-15 05:11:03.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425062&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
|
||
2026-01-15 05:11:04.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job×tamp=1768425064 status=200 resp_size=5666
|
||
2026-01-15 05:11:04.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425064&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:11:06.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job×tamp=1768425066 status=200 resp_size=5591
|
||
2026-01-15 05:11:07.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425066&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:11:16.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137638?api_key=51job×tamp=1768425075 status=200 resp_size=5651
|
||
2026-01-15 05:11:16.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425076&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 05:11:19.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job×tamp=1768425079 status=200 resp_size=4864
|
||
2026-01-15 05:11:19.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425079&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:11:21.200 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job×tamp=1768425080 status=200 resp_size=4333
|
||
2026-01-15 05:11:21.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425081&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
|
||
2026-01-15 05:11:29.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165945462?api_key=51job×tamp=1768425088 status=200 resp_size=5317
|
||
2026-01-15 05:11:29.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425089&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:11:29.243 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:11:34.960 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:11:34.960 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
|
||
2026-01-15 05:11:42.628 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.66 秒后继续...
|
||
2026-01-15 05:11:42.628 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 19/26 页...
|
||
2026-01-15 05:11:42.628 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:11:42.653 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:11:43.233 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:11:44.380 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:11:46.516 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:11:46.516 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:11:46.955 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425102 status=200 resp_size=121995
|
||
2026-01-15 05:11:46.955 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:11:47.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job×tamp=1768425106 status=200 resp_size=6269
|
||
2026-01-15 05:11:47.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425107&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
|
||
2026-01-15 05:11:52.216 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job×tamp=1768425112 status=200 resp_size=5481
|
||
2026-01-15 05:11:52.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425112&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
|
||
2026-01-15 05:12:01.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job×tamp=1768425121 status=200 resp_size=6454
|
||
2026-01-15 05:12:02.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425121&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:12:05.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job×tamp=1768425125 status=200 resp_size=8675
|
||
2026-01-15 05:12:05.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425125&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
|
||
2026-01-15 05:12:08.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168047501?api_key=51job×tamp=1768425128 status=200 resp_size=5938
|
||
2026-01-15 05:12:08.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425128&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
|
||
2026-01-15 05:12:16.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job×tamp=1768425135 status=200 resp_size=8440
|
||
2026-01-15 05:12:16.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425136&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7555
|
||
2026-01-15 05:12:17.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job×tamp=1768425137 status=200 resp_size=6458
|
||
2026-01-15 05:12:18.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425137&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:12:26.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200118?api_key=51job×tamp=1768425146 status=200 resp_size=5227
|
||
2026-01-15 05:12:26.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425146&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 05:12:31.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768425150 status=200 resp_size=5162
|
||
2026-01-15 05:12:31.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425151&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-15 05:12:35.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248400?api_key=51job×tamp=1768425155 status=200 resp_size=6414
|
||
2026-01-15 05:12:35.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425155&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2937
|
||
2026-01-15 05:12:42.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job×tamp=1768425161 status=200 resp_size=6062
|
||
2026-01-15 05:12:42.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425162&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
|
||
2026-01-15 05:12:50.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768425169 status=200 resp_size=5449
|
||
2026-01-15 05:12:50.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425170&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 05:12:55.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job×tamp=1768425174 status=200 resp_size=5714
|
||
2026-01-15 05:12:55.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425175&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 05:13:01.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job×tamp=1768425181 status=200 resp_size=6976
|
||
2026-01-15 05:13:01.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425181&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 05:13:04.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job×tamp=1768425184 status=200 resp_size=5837
|
||
2026-01-15 05:13:04.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425184&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 05:13:09.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job×tamp=1768425188 status=200 resp_size=5506
|
||
2026-01-15 05:13:09.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425189&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 05:13:17.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job×tamp=1768425196 status=200 resp_size=5845
|
||
2026-01-15 05:13:17.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425197&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 05:13:19.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job×tamp=1768425199 status=200 resp_size=6139
|
||
2026-01-15 05:13:19.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425199&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 05:13:23.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job×tamp=1768425203 status=200 resp_size=5605
|
||
2026-01-15 05:13:23.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425203&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
|
||
2026-01-15 05:13:28.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job×tamp=1768425208 status=200 resp_size=5636
|
||
2026-01-15 05:13:29.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425208&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
|
||
2026-01-15 05:13:29.139 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:13:34.804 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:13:34.804 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
|
||
2026-01-15 05:13:37.554 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.74 秒后继续...
|
||
2026-01-15 05:13:37.554 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 20/26 页...
|
||
2026-01-15 05:13:37.554 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:13:37.585 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:13:38.182 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:13:39.329 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:13:41.480 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:13:41.480 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:13:42.139 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425217 status=200 resp_size=109410
|
||
2026-01-15 05:13:42.139 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:13:42.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job×tamp=1768425222 status=200 resp_size=6222
|
||
2026-01-15 05:13:42.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425222&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 05:13:43.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001765?api_key=51job×tamp=1768425223 status=200 resp_size=7746
|
||
2026-01-15 05:13:43.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425223&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 05:13:46.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job×tamp=1768425225 status=200 resp_size=5400
|
||
2026-01-15 05:13:46.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425226&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 05:13:52.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job×tamp=1768425232 status=200 resp_size=5846
|
||
2026-01-15 05:13:53.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425232&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 05:14:02.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job×tamp=1768425241 status=200 resp_size=4627
|
||
2026-01-15 05:14:02.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425242&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 05:14:03.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job×tamp=1768425243 status=200 resp_size=6088
|
||
2026-01-15 05:14:03.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425243&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:14:07.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job×tamp=1768425247 status=200 resp_size=6341
|
||
2026-01-15 05:14:07.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425247&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
|
||
2026-01-15 05:14:17.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job×tamp=1768425257 status=200 resp_size=6896
|
||
2026-01-15 05:14:18.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425257&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
|
||
2026-01-15 05:14:23.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job×tamp=1768425263 status=200 resp_size=5290
|
||
2026-01-15 05:14:24.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425263&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 05:14:29.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job×tamp=1768425268 status=200 resp_size=5974
|
||
2026-01-15 05:14:29.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425269&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:14:33.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job×tamp=1768425272 status=200 resp_size=6435
|
||
2026-01-15 05:14:33.666 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425273&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
|
||
2026-01-15 05:14:41.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job×tamp=1768425281 status=200 resp_size=6490
|
||
2026-01-15 05:14:41.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425281&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
|
||
2026-01-15 05:14:48.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job×tamp=1768425288 status=200 resp_size=6194
|
||
2026-01-15 05:14:48.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425288&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
|
||
2026-01-15 05:14:54.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job×tamp=1768425293 status=200 resp_size=6076
|
||
2026-01-15 05:14:54.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425294&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:14:58.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job×tamp=1768425298 status=200 resp_size=5526
|
||
2026-01-15 05:14:58.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425298&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
|
||
2026-01-15 05:15:01.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job×tamp=1768425301 status=200 resp_size=6819
|
||
2026-01-15 05:15:01.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425301&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
|
||
2026-01-15 05:15:10.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job×tamp=1768425310 status=200 resp_size=5832
|
||
2026-01-15 05:15:11.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425310&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 05:15:16.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job×tamp=1768425315 status=200 resp_size=4786
|
||
2026-01-15 05:15:16.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425316&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:15:25.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job×tamp=1768425325 status=200 resp_size=6984
|
||
2026-01-15 05:15:25.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425325&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
|
||
2026-01-15 05:15:36.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job×tamp=1768425335 status=200 resp_size=5434
|
||
2026-01-15 05:15:36.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425336&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
|
||
2026-01-15 05:15:36.465 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:15:42.057 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:15:42.057 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
|
||
2026-01-15 05:15:43.245 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.18 秒后继续...
|
||
2026-01-15 05:15:43.245 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 21/26 页...
|
||
2026-01-15 05:15:43.245 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:15:43.266 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:15:43.816 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:15:44.947 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:15:47.053 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:15:47.053 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:15:47.477 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425343 status=200 resp_size=106372
|
||
2026-01-15 05:15:47.477 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:15:47.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job×tamp=1768425347 status=200 resp_size=6066
|
||
2026-01-15 05:15:47.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425347&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
|
||
2026-01-15 05:15:52.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job×tamp=1768425352 status=200 resp_size=5541
|
||
2026-01-15 05:15:53.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425352&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
|
||
2026-01-15 05:15:57.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job×tamp=1768425356 status=200 resp_size=6058
|
||
2026-01-15 05:15:57.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425357&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
|
||
2026-01-15 05:15:59.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170253725?api_key=51job×tamp=1768425359 status=200 resp_size=5879
|
||
2026-01-15 05:16:00.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425359&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 05:16:01.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job×tamp=1768425361 status=200 resp_size=5379
|
||
2026-01-15 05:16:01.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425361&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 05:16:03.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job×tamp=1768425362 status=200 resp_size=5655
|
||
2026-01-15 05:16:03.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425363&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 05:16:10.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job×tamp=1768425370 status=200 resp_size=6286
|
||
2026-01-15 05:16:11.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425370&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
|
||
2026-01-15 05:16:19.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254415?api_key=51job×tamp=1768425378 status=200 resp_size=5496
|
||
2026-01-15 05:16:19.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425379&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 05:16:26.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241414?api_key=51job×tamp=1768425386 status=200 resp_size=6106
|
||
2026-01-15 05:16:27.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425386&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
|
||
2026-01-15 05:16:34.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job×tamp=1768425393 status=200 resp_size=6326
|
||
2026-01-15 05:16:34.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425394&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
|
||
2026-01-15 05:16:41.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job×tamp=1768425401 status=200 resp_size=5398
|
||
2026-01-15 05:16:42.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425401&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
|
||
2026-01-15 05:16:46.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job×tamp=1768425406 status=200 resp_size=5294
|
||
2026-01-15 05:16:46.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425406&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:16:53.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job×tamp=1768425413 status=200 resp_size=5984
|
||
2026-01-15 05:16:54.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425413&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
|
||
2026-01-15 05:16:57.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job×tamp=1768425417 status=200 resp_size=5662
|
||
2026-01-15 05:16:57.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425417&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3069
|
||
2026-01-15 05:16:59.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234223?api_key=51job×tamp=1768425418 status=200 resp_size=5835
|
||
2026-01-15 05:16:59.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425419&companyId=10138236&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5280
|
||
2026-01-15 05:17:01.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job×tamp=1768425421 status=200 resp_size=6131
|
||
2026-01-15 05:17:02.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425421&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
|
||
2026-01-15 05:17:10.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job×tamp=1768425429 status=200 resp_size=6106
|
||
2026-01-15 05:17:10.212 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425430&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:17:14.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170246615?api_key=51job×tamp=1768425434 status=200 resp_size=5951
|
||
2026-01-15 05:17:14.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425434&companyId=10140701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
|
||
2026-01-15 05:17:23.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job×tamp=1768425442 status=200 resp_size=6219
|
||
2026-01-15 05:17:23.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425443&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
|
||
2026-01-15 05:17:31.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job×tamp=1768425450 status=200 resp_size=6041
|
||
2026-01-15 05:17:31.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425451&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
|
||
2026-01-15 05:17:31.716 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:17:37.228 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:17:37.228 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
|
||
2026-01-15 05:17:42.362 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.13 秒后继续...
|
||
2026-01-15 05:17:42.362 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 22/26 页...
|
||
2026-01-15 05:17:42.362 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:17:42.392 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:17:43.004 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:17:44.135 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:17:46.287 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:17:46.287 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:17:46.727 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425462 status=200 resp_size=132711
|
||
2026-01-15 05:17:46.727 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:17:46.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job×tamp=1768425466 status=200 resp_size=5675
|
||
2026-01-15 05:17:47.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425466&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:17:52.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job×tamp=1768425472 status=200 resp_size=5849
|
||
2026-01-15 05:17:52.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425472&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 05:17:55.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job×tamp=1768425475 status=200 resp_size=5335
|
||
2026-01-15 05:17:55.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425475&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:18:05.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job×tamp=1768425484 status=200 resp_size=6351
|
||
2026-01-15 05:18:05.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425485&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
|
||
2026-01-15 05:18:13.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job×tamp=1768425492 status=200 resp_size=6113
|
||
2026-01-15 05:18:13.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425493&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:18:20.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job×tamp=1768425499 status=200 resp_size=5829
|
||
2026-01-15 05:18:20.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425500&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
|
||
2026-01-15 05:18:29.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job×tamp=1768425508 status=200 resp_size=6321
|
||
2026-01-15 05:18:30.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425509&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:18:39.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job×tamp=1768425518 status=200 resp_size=5095
|
||
2026-01-15 05:18:39.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425519&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
|
||
2026-01-15 05:18:47.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job×tamp=1768425526 status=200 resp_size=6385
|
||
2026-01-15 05:18:47.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425527&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:18:56.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job×tamp=1768425536 status=200 resp_size=5107
|
||
2026-01-15 05:18:57.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425536&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
|
||
2026-01-15 05:19:00.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job×tamp=1768425540 status=200 resp_size=6497
|
||
2026-01-15 05:19:00.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425540&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:19:07.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job×tamp=1768425546 status=200 resp_size=6053
|
||
2026-01-15 05:19:07.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425547&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 05:19:16.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job×tamp=1768425556 status=200 resp_size=6963
|
||
2026-01-15 05:19:16.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425556&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:19:26.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170149383?api_key=51job×tamp=1768425565 status=200 resp_size=5197
|
||
2026-01-15 05:19:26.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425566&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:19:31.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job×tamp=1768425571 status=200 resp_size=5473
|
||
2026-01-15 05:19:32.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425571&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:19:35.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job×tamp=1768425575 status=200 resp_size=7337
|
||
2026-01-15 05:19:35.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425575&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-15 05:19:44.282 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job×tamp=1768425583 status=200 resp_size=7079
|
||
2026-01-15 05:19:44.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425584&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
|
||
2026-01-15 05:19:49.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job×tamp=1768425589 status=200 resp_size=5703
|
||
2026-01-15 05:19:49.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425589&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:19:56.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job×tamp=1768425596 status=200 resp_size=6074
|
||
2026-01-15 05:19:57.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425596&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:20:07.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job×tamp=1768425606 status=200 resp_size=6216
|
||
2026-01-15 05:20:07.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425607&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 05:20:07.257 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:20:07.555 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:20:07.555 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
|
||
2026-01-15 05:20:12.249 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.69 秒后继续...
|
||
2026-01-15 05:20:12.249 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 23/26 页...
|
||
2026-01-15 05:20:12.251 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:20:12.267 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:20:12.895 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:20:14.120 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:20:16.277 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:20:16.277 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:20:16.759 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425612 status=200 resp_size=133854
|
||
2026-01-15 05:20:16.759 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:20:18.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163648773?api_key=51job×tamp=1768425616 status=200 resp_size=5924
|
||
2026-01-15 05:20:18.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425618&companyId=8851107&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3258
|
||
2026-01-15 05:20:28.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job×tamp=1768425627 status=200 resp_size=4841
|
||
2026-01-15 05:20:28.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425628&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:20:35.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job×tamp=1768425634 status=200 resp_size=5236
|
||
2026-01-15 05:20:35.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425635&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:20:43.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job×tamp=1768425643 status=200 resp_size=6275
|
||
2026-01-15 05:20:44.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425643&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
|
||
2026-01-15 05:20:49.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job×tamp=1768425648 status=200 resp_size=6316
|
||
2026-01-15 05:20:49.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425649&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 05:21:01.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job×tamp=1768425657 status=200 resp_size=5112
|
||
2026-01-15 05:21:01.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425661&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:21:09.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job×tamp=1768425668 status=200 resp_size=5510
|
||
2026-01-15 05:21:09.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425669&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:21:13.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169283559?api_key=51job×tamp=1768425672 status=200 resp_size=6215
|
||
2026-01-15 05:21:14.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425673&companyId=2143307&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11154
|
||
2026-01-15 05:21:16.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job×tamp=1768425676 status=200 resp_size=6150
|
||
2026-01-15 05:21:17.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425676&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
|
||
2026-01-15 05:21:23.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169180023?api_key=51job×tamp=1768425683 status=200 resp_size=5166
|
||
2026-01-15 05:21:24.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425683&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:21:27.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job×tamp=1768425687 status=200 resp_size=5321
|
||
2026-01-15 05:21:28.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425687&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:21:32.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170219997?api_key=51job×tamp=1768425691 status=200 resp_size=5148
|
||
2026-01-15 05:21:32.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425692&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:21:35.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job×tamp=1768425695 status=200 resp_size=5188
|
||
2026-01-15 05:21:36.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425695&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:21:41.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job×tamp=1768425701 status=200 resp_size=5055
|
||
2026-01-15 05:21:42.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425701&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:21:44.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job×tamp=1768425704 status=200 resp_size=5373
|
||
2026-01-15 05:21:44.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425704&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:21:52.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job×tamp=1768425711 status=200 resp_size=4847
|
||
2026-01-15 05:21:52.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425712&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:21:59.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job×tamp=1768425718 status=200 resp_size=4861
|
||
2026-01-15 05:21:59.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425719&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:22:05.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167093089?api_key=51job×tamp=1768425725 status=200 resp_size=5600
|
||
2026-01-15 05:22:05.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425725&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:22:17.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job×tamp=1768425735 status=200 resp_size=4962
|
||
2026-01-15 05:22:18.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425737&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:22:19.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job×tamp=1768425739 status=200 resp_size=5032
|
||
2026-01-15 05:22:20.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425739&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:22:20.338 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:22:26.411 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:22:26.427 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
|
||
2026-01-15 05:22:33.451 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.02 秒后继续...
|
||
2026-01-15 05:22:33.451 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 24/26 页...
|
||
2026-01-15 05:22:33.451 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:22:33.478 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:22:34.090 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:22:35.222 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:22:37.419 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:22:37.419 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:22:38.214 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425753 status=200 resp_size=138702
|
||
2026-01-15 05:22:38.214 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:22:38.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job×tamp=1768425758 status=200 resp_size=5409
|
||
2026-01-15 05:22:38.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425758&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:22:46.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job×tamp=1768425765 status=200 resp_size=5182
|
||
2026-01-15 05:22:46.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425766&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:22:49.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job×tamp=1768425769 status=200 resp_size=5570
|
||
2026-01-15 05:22:49.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425769&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:22:53.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job×tamp=1768425772 status=200 resp_size=5552
|
||
2026-01-15 05:22:53.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425773&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:23:01.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467871?api_key=51job×tamp=1768425781 status=200 resp_size=5503
|
||
2026-01-15 05:23:02.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425781&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:23:10.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168043085?api_key=51job×tamp=1768425789 status=200 resp_size=5489
|
||
2026-01-15 05:23:10.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425790&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:23:14.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job×tamp=1768425794 status=200 resp_size=5461
|
||
2026-01-15 05:23:14.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425794&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:23:18.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job×tamp=1768425797 status=200 resp_size=5295
|
||
2026-01-15 05:23:18.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425798&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:23:21.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job×tamp=1768425801 status=200 resp_size=5200
|
||
2026-01-15 05:23:21.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425801&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:23:27.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170254675?api_key=51job×tamp=1768425807 status=200 resp_size=4383
|
||
2026-01-15 05:23:27.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425807&companyId=10152097&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2724
|
||
2026-01-15 05:23:38.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job×tamp=1768425817 status=200 resp_size=4985
|
||
2026-01-15 05:23:39.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425818&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:23:40.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job×tamp=1768425820 status=200 resp_size=5207
|
||
2026-01-15 05:23:40.957 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425820&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:23:45.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job×tamp=1768425825 status=200 resp_size=10634
|
||
2026-01-15 05:23:46.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425825&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-15 05:23:51.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job×tamp=1768425831 status=200 resp_size=4990
|
||
2026-01-15 05:23:52.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425831&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
|
||
2026-01-15 05:23:58.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job×tamp=1768425838 status=200 resp_size=4972
|
||
2026-01-15 05:23:59.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425838&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:24:09.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job×tamp=1768425848 status=200 resp_size=5173
|
||
2026-01-15 05:24:09.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425849&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:24:20.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169409904?api_key=51job×tamp=1768425859 status=200 resp_size=5236
|
||
2026-01-15 05:24:20.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425860&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 05:24:30.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job×tamp=1768425870 status=200 resp_size=4315
|
||
2026-01-15 05:24:31.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425870&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
|
||
2026-01-15 05:24:38.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job×tamp=1768425877 status=200 resp_size=5158
|
||
2026-01-15 05:24:38.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425878&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:24:40.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job×tamp=1768425880 status=200 resp_size=7684
|
||
2026-01-15 05:24:41.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425880&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
|
||
2026-01-15 05:24:41.610 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:24:47.719 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:24:47.719 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
|
||
2026-01-15 05:24:56.019 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.29 秒后继续...
|
||
2026-01-15 05:24:56.019 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 25/26 页...
|
||
2026-01-15 05:24:56.019 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:24:56.045 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:24:56.877 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:24:58.025 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:25:00.176 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:25:00.176 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:25:00.631 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768425896 status=200 resp_size=126461
|
||
2026-01-15 05:25:00.631 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:25:00.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job×tamp=1768425900 status=200 resp_size=6095
|
||
2026-01-15 05:25:01.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425900&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:25:11.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job×tamp=1768425910 status=200 resp_size=5147
|
||
2026-01-15 05:25:11.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425911&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
|
||
2026-01-15 05:25:18.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job×tamp=1768425917 status=200 resp_size=4978
|
||
2026-01-15 05:25:18.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425918&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:25:26.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job×tamp=1768425925 status=200 resp_size=6401
|
||
2026-01-15 05:25:26.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425926&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:25:36.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job×tamp=1768425935 status=200 resp_size=6101
|
||
2026-01-15 05:25:36.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425936&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:25:45.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job×tamp=1768425944 status=200 resp_size=4991
|
||
2026-01-15 05:25:45.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425945&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
|
||
2026-01-15 05:25:50.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job×tamp=1768425950 status=200 resp_size=5026
|
||
2026-01-15 05:25:50.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425950&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:25:52.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job×tamp=1768425952 status=200 resp_size=6793
|
||
2026-01-15 05:25:52.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425952&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:26:01.141 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job×tamp=1768425960 status=200 resp_size=6117
|
||
2026-01-15 05:26:01.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425961&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:26:11.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167859966?api_key=51job×tamp=1768425970 status=200 resp_size=5111
|
||
2026-01-15 05:26:11.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425971&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:26:14.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job×tamp=1768425973 status=200 resp_size=4859
|
||
2026-01-15 05:26:14.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425974&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:26:20.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246891?api_key=51job×tamp=1768425979 status=200 resp_size=4835
|
||
2026-01-15 05:26:20.472 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425980&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-15 05:26:27.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job×tamp=1768425987 status=200 resp_size=6108
|
||
2026-01-15 05:26:27.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425987&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:26:32.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job×tamp=1768425992 status=200 resp_size=7131
|
||
2026-01-15 05:26:32.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768425992&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
|
||
2026-01-15 05:26:42.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169153227?api_key=51job×tamp=1768426001 status=200 resp_size=5992
|
||
2026-01-15 05:26:42.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426002&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
|
||
2026-01-15 05:26:44.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659828?api_key=51job×tamp=1768426004 status=200 resp_size=6109
|
||
2026-01-15 05:26:44.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426004&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:26:53.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job×tamp=1768426012 status=200 resp_size=6544
|
||
2026-01-15 05:26:53.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426013&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 05:26:57.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job×tamp=1768426017 status=200 resp_size=7105
|
||
2026-01-15 05:26:57.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426017&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
|
||
2026-01-15 05:27:04.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job×tamp=1768426023 status=200 resp_size=6531
|
||
2026-01-15 05:27:04.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426024&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
|
||
2026-01-15 05:27:08.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job×tamp=1768426028 status=200 resp_size=6115
|
||
2026-01-15 05:27:08.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426028&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:27:08.895 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:27:14.848 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:27:14.861 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
|
||
2026-01-15 05:27:23.849 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.99 秒后继续...
|
||
2026-01-15 05:27:23.849 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 26/26 页...
|
||
2026-01-15 05:27:23.849 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:27:23.868 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=锦州, 工作类型=0154
|
||
2026-01-15 05:27:24.450 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:27:25.581 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:27:27.720 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:27:27.720 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:27:28.128 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426043 status=200 resp_size=111752
|
||
2026-01-15 05:27:28.128 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 17 个职位(去重后: 17) | API返回totalCount: 517 (原始值: 517) | 地区: 锦州(锦州) | 职能: 全栈工程师(0154)
|
||
2026-01-15 05:27:28.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job×tamp=1768426048 status=200 resp_size=4704
|
||
2026-01-15 05:27:28.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426048&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
|
||
2026-01-15 05:27:38.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job×tamp=1768426058 status=200 resp_size=6427
|
||
2026-01-15 05:27:39.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426058&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
|
||
2026-01-15 05:27:42.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167783950?api_key=51job×tamp=1768426062 status=200 resp_size=5737
|
||
2026-01-15 05:27:42.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426062&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 05:27:44.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job×tamp=1768426063 status=200 resp_size=6044
|
||
2026-01-15 05:27:44.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426064&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:27:47.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job×tamp=1768426067 status=200 resp_size=5499
|
||
2026-01-15 05:27:47.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426067&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
|
||
2026-01-15 05:27:54.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job×tamp=1768426073 status=200 resp_size=6107
|
||
2026-01-15 05:27:55.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426074&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:02.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job×tamp=1768426081 status=200 resp_size=5880
|
||
2026-01-15 05:28:02.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426082&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:28:07.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job×tamp=1768426086 status=200 resp_size=5139
|
||
2026-01-15 05:28:07.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426087&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:28:10.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job×tamp=1768426090 status=200 resp_size=5903
|
||
2026-01-15 05:28:10.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426090&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
|
||
2026-01-15 05:28:17.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job×tamp=1768426096 status=200 resp_size=6113
|
||
2026-01-15 05:28:17.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426097&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:20.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job×tamp=1768426100 status=200 resp_size=5129
|
||
2026-01-15 05:28:20.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426100&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
|
||
2026-01-15 05:28:28.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job×tamp=1768426108 status=200 resp_size=5241
|
||
2026-01-15 05:28:29.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426108&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:28:35.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job×tamp=1768426115 status=200 resp_size=6107
|
||
2026-01-15 05:28:36.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426115&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:43.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job×tamp=1768426123 status=200 resp_size=6109
|
||
2026-01-15 05:28:44.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426123&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:47.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job×tamp=1768426126 status=200 resp_size=6111
|
||
2026-01-15 05:28:48.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426127&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:50.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job×tamp=1768426130 status=200 resp_size=5151
|
||
2026-01-15 05:28:50.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426130&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:28:53.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job×tamp=1768426132 status=200 resp_size=6122
|
||
2026-01-15 05:28:53.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426133&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
|
||
2026-01-15 05:28:53.782 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据,包含详细信息的数据条数: 17
|
||
2026-01-15 05:28:54.067 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 17 个职位 | 累计: 517 个
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (517/517),提前结束爬取
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1056 -
|
||
================================================================================
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 517 条
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 515 条
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 2 条
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 517 条
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 锦州(锦州)
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 全栈工程师(0154)
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 99.61% (515/517)
|
||
2026-01-15 05:28:54.067 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(515) < API返回总数(517),可能存在分页问题或数据过滤
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
|
||
|
||
2026-01-15 05:28:54.067 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 515 条记录)
|
||
2026-01-15 05:28:54.067 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成!共找到 515 个职位
|
||
2026-01-15 05:28:54.067 | INFO | __main__:close:1137 - httpx客户端已关闭
|
||
2026-01-15 05:28:59.382 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:28:59.390 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:28:59.767 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位,最多 50 页
|
||
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-15 05:28:59.767 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-15 05:28:59.767 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:28:59.798 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:29:00.379 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:29:01.525 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:29:03.677 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:29:03.677 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:29:04.117 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426139 status=200 resp_size=108815
|
||
2026-01-15 05:29:04.117 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:29:04.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768426144 status=200 resp_size=8244
|
||
2026-01-15 05:29:04.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426144&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-15 05:29:15.033 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768426152 status=200 resp_size=5184
|
||
2026-01-15 05:29:15.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426155&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 05:29:19.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768426159 status=200 resp_size=5579
|
||
2026-01-15 05:29:19.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426159&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 05:29:22.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768426161 status=200 resp_size=5000
|
||
2026-01-15 05:29:22.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426162&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-15 05:29:24.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768426164 status=200 resp_size=5029
|
||
2026-01-15 05:29:24.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426164&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 05:29:30.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768426169 status=200 resp_size=5630
|
||
2026-01-15 05:29:31.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426170&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 05:29:33.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768426172 status=200 resp_size=5546
|
||
2026-01-15 05:29:33.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426173&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-15 05:29:42.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768426181 status=200 resp_size=6579
|
||
2026-01-15 05:29:42.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426182&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-15 05:29:48.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768426188 status=200 resp_size=4913
|
||
2026-01-15 05:29:48.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426188&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 05:29:56.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768426196 status=200 resp_size=5739
|
||
2026-01-15 05:29:56.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426196&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-15 05:30:00.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768426200 status=200 resp_size=6192
|
||
2026-01-15 05:30:00.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426200&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 05:30:04.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768426204 status=200 resp_size=6139
|
||
2026-01-15 05:30:04.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426204&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 05:30:08.914 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768426208 status=200 resp_size=4954
|
||
2026-01-15 05:30:09.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426208&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-15 05:30:17.665 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768426216 status=200 resp_size=5813
|
||
2026-01-15 05:30:18.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426217&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 05:30:28.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768426227 status=200 resp_size=5890
|
||
2026-01-15 05:30:29.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426228&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:30:36.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768426235 status=200 resp_size=4892
|
||
2026-01-15 05:30:36.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426236&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-15 05:30:46.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768426246 status=200 resp_size=5976
|
||
2026-01-15 05:30:47.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426246&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 05:30:48.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768426248 status=200 resp_size=5431
|
||
2026-01-15 05:30:49.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426248&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-15 05:30:56.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768426255 status=200 resp_size=6023
|
||
2026-01-15 05:30:56.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426256&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:31:04.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768426263 status=200 resp_size=6048
|
||
2026-01-15 05:31:05.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426264&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:31:05.379 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:31:11.144 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:31:11.144 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 517 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-15 05:31:11.144 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-15 05:31:18.216 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.06 秒后继续...
|
||
2026-01-15 05:31:18.216 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-15 05:31:18.216 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:31:18.243 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:31:18.761 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:31:19.876 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:31:21.997 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:31:21.997 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:31:22.421 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426278 status=200 resp_size=108122
|
||
2026-01-15 05:31:22.421 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:31:22.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768426282 status=200 resp_size=5280
|
||
2026-01-15 05:31:22.751 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426282&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-15 05:31:32.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768426292 status=200 resp_size=6192
|
||
2026-01-15 05:31:33.161 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426292&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-15 05:31:37.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768426297 status=200 resp_size=5754
|
||
2026-01-15 05:31:37.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426297&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 05:31:44.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768426304 status=200 resp_size=7534
|
||
2026-01-15 05:31:45.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426304&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-15 05:31:55.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768426314 status=200 resp_size=6399
|
||
2026-01-15 05:31:56.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426315&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:32:02.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162384396?api_key=51job×tamp=1768426322 status=200 resp_size=6787
|
||
2026-01-15 05:32:03.064 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426322&companyId=8968194&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2924
|
||
2026-01-15 05:32:13.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768426331 status=200 resp_size=5480
|
||
2026-01-15 05:32:13.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426333&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-15 05:32:17.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768426336 status=200 resp_size=5190
|
||
2026-01-15 05:32:17.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426337&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-15 05:32:26.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768426345 status=200 resp_size=6137
|
||
2026-01-15 05:32:26.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426346&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-15 05:32:29.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768426349 status=200 resp_size=6134
|
||
2026-01-15 05:32:29.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426349&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-15 05:32:35.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768426354 status=200 resp_size=5591
|
||
2026-01-15 05:32:35.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426355&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-15 05:32:46.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768426365 status=200 resp_size=5110
|
||
2026-01-15 05:32:46.398 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426366&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-15 05:32:55.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768426373 status=200 resp_size=6366
|
||
2026-01-15 05:32:55.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426375&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-15 05:33:01.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768426380 status=200 resp_size=5960
|
||
2026-01-15 05:33:01.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426381&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-15 05:33:11.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768426390 status=200 resp_size=5613
|
||
2026-01-15 05:33:11.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426391&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:33:14.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768426394 status=200 resp_size=5374
|
||
2026-01-15 05:33:15.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426394&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:33:21.435 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768426400 status=200 resp_size=6423
|
||
2026-01-15 05:33:21.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426401&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:33:23.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768426403 status=200 resp_size=5484
|
||
2026-01-15 05:33:23.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426403&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 05:33:33.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768426412 status=200 resp_size=5603
|
||
2026-01-15 05:33:33.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426413&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 05:33:38.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768426417 status=200 resp_size=5694
|
||
2026-01-15 05:33:38.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426418&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:33:38.796 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:33:44.527 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:33:44.543 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-15 05:33:50.276 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.73 秒后继续...
|
||
2026-01-15 05:33:50.276 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-15 05:33:50.276 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:33:50.307 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:33:50.872 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:33:52.081 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:33:54.216 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:33:54.216 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:33:54.765 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426430 status=200 resp_size=115509
|
||
2026-01-15 05:33:54.765 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:33:55.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768426434 status=200 resp_size=6179
|
||
2026-01-15 05:33:55.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426435&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 05:33:59.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768426439 status=200 resp_size=5513
|
||
2026-01-15 05:33:59.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426439&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:34:05.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768426444 status=200 resp_size=6076
|
||
2026-01-15 05:34:05.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426445&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-15 05:34:08.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768426448 status=200 resp_size=5661
|
||
2026-01-15 05:34:08.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426448&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-15 05:34:16.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768426456 status=200 resp_size=5845
|
||
2026-01-15 05:34:17.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426456&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:34:27.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768426466 status=200 resp_size=5513
|
||
2026-01-15 05:34:27.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426467&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-15 05:34:36.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768426476 status=200 resp_size=6285
|
||
2026-01-15 05:34:36.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426476&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-15 05:34:39.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768426479 status=200 resp_size=5127
|
||
2026-01-15 05:34:40.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426479&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-15 05:34:49.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768426488 status=200 resp_size=7499
|
||
2026-01-15 05:34:49.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426489&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 05:34:55.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768426494 status=200 resp_size=5182
|
||
2026-01-15 05:34:56.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426495&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-15 05:34:58.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768426498 status=200 resp_size=5988
|
||
2026-01-15 05:34:58.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426498&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-15 05:35:06.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768426506 status=200 resp_size=5333
|
||
2026-01-15 05:35:06.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426506&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:35:13.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768426511 status=200 resp_size=8364
|
||
2026-01-15 05:35:13.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426513&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-15 05:35:18.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768426518 status=200 resp_size=5725
|
||
2026-01-15 05:35:19.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426518&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-15 05:35:27.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768426526 status=200 resp_size=5729
|
||
2026-01-15 05:35:27.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426527&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:35:29.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768426529 status=200 resp_size=5229
|
||
2026-01-15 05:35:29.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426529&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 05:35:36.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768426535 status=200 resp_size=5632
|
||
2026-01-15 05:35:36.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426536&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-15 05:35:46.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768426545 status=200 resp_size=5723
|
||
2026-01-15 05:35:46.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426546&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-15 05:35:53.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768426551 status=200 resp_size=6030
|
||
2026-01-15 05:35:53.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426553&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-15 05:35:57.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768426557 status=200 resp_size=5245
|
||
2026-01-15 05:35:57.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426557&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-15 05:35:57.880 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:35:58.131 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:35:58.131 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-15 05:36:06.897 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.76 秒后继续...
|
||
2026-01-15 05:36:06.897 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-15 05:36:06.897 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:36:06.922 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:36:07.786 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:36:09.184 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:36:11.496 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:36:11.496 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:36:12.216 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426566 status=200 resp_size=117007
|
||
2026-01-15 05:36:12.216 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:36:12.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768426572 status=200 resp_size=6024
|
||
2026-01-15 05:36:13.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426572&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:36:17.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768426576 status=200 resp_size=6651
|
||
2026-01-15 05:36:17.824 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426577&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 05:36:25.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768426584 status=200 resp_size=5833
|
||
2026-01-15 05:36:25.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426585&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:36:28.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768426588 status=200 resp_size=6448
|
||
2026-01-15 05:36:28.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426588&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 05:36:34.425 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768426593 status=200 resp_size=6718
|
||
2026-01-15 05:36:34.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426594&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-15 05:36:44.696 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768426604 status=200 resp_size=6466
|
||
2026-01-15 05:36:44.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426604&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:36:47.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768426607 status=200 resp_size=5793
|
||
2026-01-15 05:36:47.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426607&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:36:53.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768426613 status=200 resp_size=5803
|
||
2026-01-15 05:36:53.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426613&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:36:55.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768426615 status=200 resp_size=6573
|
||
2026-01-15 05:36:55.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426615&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 05:37:05.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768426625 status=200 resp_size=5961
|
||
2026-01-15 05:37:05.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426625&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:37:15.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768426635 status=200 resp_size=6392
|
||
2026-01-15 05:37:15.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426635&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 05:37:27.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768426645 status=200 resp_size=6049
|
||
2026-01-15 05:37:27.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426647&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:37:34.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768426653 status=200 resp_size=6715
|
||
2026-01-15 05:37:34.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426654&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-15 05:37:40.581 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768426659 status=200 resp_size=6511
|
||
2026-01-15 05:37:40.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426660&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-15 05:37:49.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768426669 status=200 resp_size=5940
|
||
2026-01-15 05:37:49.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426669&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:37:54.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768426674 status=200 resp_size=4058
|
||
2026-01-15 05:37:55.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426674&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-15 05:37:59.017 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768426678 status=200 resp_size=5421
|
||
2026-01-15 05:37:59.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426679&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:38:09.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768426688 status=200 resp_size=5232
|
||
2026-01-15 05:38:09.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426689&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:38:19.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768426698 status=200 resp_size=6177
|
||
2026-01-15 05:38:19.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426699&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 05:38:26.267 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768426705 status=200 resp_size=5634
|
||
2026-01-15 05:38:26.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426706&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:38:26.596 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:38:26.973 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:38:26.973 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-15 05:38:28.641 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.66 秒后继续...
|
||
2026-01-15 05:38:28.641 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-15 05:38:28.641 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:38:28.669 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:38:30.366 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:38:32.580 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:38:34.858 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:38:34.858 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:38:35.392 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426708 status=200 resp_size=129793
|
||
2026-01-15 05:38:35.392 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:38:36.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768426715 status=200 resp_size=5699
|
||
2026-01-15 05:38:36.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426716&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-15 05:38:46.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768426725 status=200 resp_size=6125
|
||
2026-01-15 05:38:46.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426726&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:38:53.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768426733 status=200 resp_size=5888
|
||
2026-01-15 05:38:53.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426733&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-15 05:38:59.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768426738 status=200 resp_size=6055
|
||
2026-01-15 05:39:00.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426739&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-15 05:39:07.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768426746 status=200 resp_size=5857
|
||
2026-01-15 05:39:07.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426747&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-15 05:39:11.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768426751 status=200 resp_size=5455
|
||
2026-01-15 05:39:11.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426751&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-15 05:39:20.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768426759 status=200 resp_size=6314
|
||
2026-01-15 05:39:20.859 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426760&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-15 05:39:28.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768426768 status=200 resp_size=5721
|
||
2026-01-15 05:39:29.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426768&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-15 05:39:34.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768426773 status=200 resp_size=5942
|
||
2026-01-15 05:39:34.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426774&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 05:39:43.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768426782 status=200 resp_size=5638
|
||
2026-01-15 05:39:43.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426783&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-15 05:39:46.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768426786 status=200 resp_size=5687
|
||
2026-01-15 05:39:46.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426786&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:39:52.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768426791 status=200 resp_size=8574
|
||
2026-01-15 05:39:52.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426792&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 05:39:56.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768426796 status=200 resp_size=7551
|
||
2026-01-15 05:39:56.560 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426796&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-15 05:40:00.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768426800 status=200 resp_size=5784
|
||
2026-01-15 05:40:00.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426800&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-15 05:40:09.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768426808 status=200 resp_size=6552
|
||
2026-01-15 05:40:09.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426809&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:40:17.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job×tamp=1768426816 status=200 resp_size=5306
|
||
2026-01-15 05:40:17.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426817&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
|
||
2026-01-15 05:40:22.494 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768426822 status=200 resp_size=7182
|
||
2026-01-15 05:40:23.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426822&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-15 05:40:33.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768426831 status=200 resp_size=5407
|
||
2026-01-15 05:40:33.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426833&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-15 05:40:39.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768426838 status=200 resp_size=5497
|
||
2026-01-15 05:40:39.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426839&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:40:41.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768426840 status=200 resp_size=5655
|
||
2026-01-15 05:40:41.223 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426841&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 05:40:41.223 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:40:47.485 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:40:47.485 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-15 05:40:50.671 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
|
||
2026-01-15 05:40:50.671 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-15 05:40:50.671 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:40:50.706 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:40:51.868 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:40:53.203 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:40:55.767 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:40:55.767 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:40:56.595 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426850 status=200 resp_size=139890
|
||
2026-01-15 05:40:56.595 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:40:56.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768426856 status=200 resp_size=6714
|
||
2026-01-15 05:40:57.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426856&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-15 05:41:07.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768426866 status=200 resp_size=6689
|
||
2026-01-15 05:41:07.654 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426867&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:41:17.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768426877 status=200 resp_size=5615
|
||
2026-01-15 05:41:17.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426877&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-15 05:41:22.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768426882 status=200 resp_size=5775
|
||
2026-01-15 05:41:23.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426882&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-15 05:41:26.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768426886 status=200 resp_size=6696
|
||
2026-01-15 05:41:27.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426886&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-15 05:41:30.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768426890 status=200 resp_size=6390
|
||
2026-01-15 05:41:30.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426890&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:41:40.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768426899 status=200 resp_size=13102
|
||
2026-01-15 05:41:41.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426900&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 05:41:44.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768426904 status=200 resp_size=5128
|
||
2026-01-15 05:41:44.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426904&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-15 05:41:50.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768426909 status=200 resp_size=6362
|
||
2026-01-15 05:41:50.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426910&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 05:41:59.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768426918 status=200 resp_size=6230
|
||
2026-01-15 05:41:59.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426919&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:42:07.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768426926 status=200 resp_size=6529
|
||
2026-01-15 05:42:07.239 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426927&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-15 05:42:08.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768426928 status=200 resp_size=7130
|
||
2026-01-15 05:42:09.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426928&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-15 05:42:19.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768426937 status=200 resp_size=7415
|
||
2026-01-15 05:42:20.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426939&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-15 05:42:28.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768426947 status=200 resp_size=8808
|
||
2026-01-15 05:42:28.452 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426948&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:42:36.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768426955 status=200 resp_size=5152
|
||
2026-01-15 05:42:36.437 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426956&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-15 05:42:41.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768426960 status=200 resp_size=5877
|
||
2026-01-15 05:42:41.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426961&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-15 05:42:47.351 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768426966 status=200 resp_size=5098
|
||
2026-01-15 05:42:47.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426967&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 05:42:58.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768426977 status=200 resp_size=5920
|
||
2026-01-15 05:42:58.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426978&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:43:00.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768426980 status=200 resp_size=6970
|
||
2026-01-15 05:43:00.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426980&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 05:43:02.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768426981 status=200 resp_size=7057
|
||
2026-01-15 05:43:02.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768426982&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-15 05:43:02.430 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:43:08.774 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:43:08.774 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-15 05:43:18.246 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.47 秒后继续...
|
||
2026-01-15 05:43:18.246 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-15 05:43:18.246 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:43:18.273 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:43:18.934 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:43:20.128 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:43:22.317 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:43:22.317 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:43:22.938 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768426998 status=200 resp_size=141798
|
||
2026-01-15 05:43:22.938 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:43:24.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768427002 status=200 resp_size=5109
|
||
2026-01-15 05:43:24.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427004&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-15 05:43:32.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768427012 status=200 resp_size=6445
|
||
2026-01-15 05:43:33.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427012&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:43:35.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768427015 status=200 resp_size=7717
|
||
2026-01-15 05:43:35.786 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427015&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-15 05:43:43.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170274394?api_key=51job×tamp=1768427022 status=200 resp_size=4321
|
||
2026-01-15 05:43:43.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427023&companyId=10154014&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3022
|
||
2026-01-15 05:43:52.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768427031 status=200 resp_size=5533
|
||
2026-01-15 05:43:52.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427032&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-15 05:43:54.788 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768427034 status=200 resp_size=6501
|
||
2026-01-15 05:43:54.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427034&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:43:58.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768427038 status=200 resp_size=5524
|
||
2026-01-15 05:43:59.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427038&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-15 05:44:04.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768427044 status=200 resp_size=6522
|
||
2026-01-15 05:44:04.433 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427044&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7945
|
||
2026-01-15 05:44:10.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768427049 status=200 resp_size=7756
|
||
2026-01-15 05:44:10.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427050&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 05:44:13.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768427052 status=200 resp_size=5756
|
||
2026-01-15 05:44:13.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427053&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:44:20.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768427060 status=200 resp_size=6318
|
||
2026-01-15 05:44:20.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427060&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-15 05:44:23.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768427063 status=200 resp_size=7311
|
||
2026-01-15 05:44:23.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427063&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-15 05:44:29.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768427069 status=200 resp_size=5458
|
||
2026-01-15 05:44:29.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427069&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-15 05:44:41.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768427079 status=200 resp_size=5678
|
||
2026-01-15 05:44:41.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427081&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:44:52.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768427091 status=200 resp_size=7237
|
||
2026-01-15 05:44:52.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427092&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-15 05:44:58.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768427097 status=200 resp_size=5342
|
||
2026-01-15 05:44:58.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427098&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-15 05:45:02.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768427102 status=200 resp_size=6431
|
||
2026-01-15 05:45:03.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427102&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-15 05:45:05.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768427105 status=200 resp_size=8457
|
||
2026-01-15 05:45:06.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427105&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:45:15.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768427114 status=200 resp_size=6416
|
||
2026-01-15 05:45:15.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427115&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 05:45:19.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768427118 status=200 resp_size=5876
|
||
2026-01-15 05:45:19.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427119&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 05:45:19.206 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:45:25.535 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:45:25.535 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-15 05:45:33.385 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.84 秒后继续...
|
||
2026-01-15 05:45:33.385 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-15 05:45:33.385 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:45:33.403 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:45:33.999 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:45:35.132 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:45:37.283 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:45:37.283 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:45:37.754 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427133 status=200 resp_size=155521
|
||
2026-01-15 05:45:37.754 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:45:38.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768427137 status=200 resp_size=5974
|
||
2026-01-15 05:45:38.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427138&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:45:39.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768427139 status=200 resp_size=6646
|
||
2026-01-15 05:45:40.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427139&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-15 05:45:45.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768427145 status=200 resp_size=5489
|
||
2026-01-15 05:45:45.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427145&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-15 05:45:46.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768427146 status=200 resp_size=6958
|
||
2026-01-15 05:45:47.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427146&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:45:56.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768427155 status=200 resp_size=6449
|
||
2026-01-15 05:45:56.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427156&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-15 05:46:05.255 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768427164 status=200 resp_size=6015
|
||
2026-01-15 05:46:05.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427165&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-15 05:46:15.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768427174 status=200 resp_size=5925
|
||
2026-01-15 05:46:15.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427175&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-15 05:46:19.409 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768427179 status=200 resp_size=6511
|
||
2026-01-15 05:46:19.628 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427179&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:46:23.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768427183 status=200 resp_size=7750
|
||
2026-01-15 05:46:23.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427183&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-15 05:46:26.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768427185 status=200 resp_size=7971
|
||
2026-01-15 05:46:26.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427186&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7844
|
||
2026-01-15 05:46:29.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768427188 status=200 resp_size=8313
|
||
2026-01-15 05:46:29.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427189&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-15 05:46:39.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768427198 status=200 resp_size=6119
|
||
2026-01-15 05:46:39.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427199&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:46:43.927 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768427203 status=200 resp_size=5424
|
||
2026-01-15 05:46:44.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427203&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-15 05:46:45.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768427205 status=200 resp_size=8274
|
||
2026-01-15 05:46:45.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427205&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-15 05:46:54.040 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768427213 status=200 resp_size=8701
|
||
2026-01-15 05:46:54.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427214&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-15 05:46:56.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768427216 status=200 resp_size=6058
|
||
2026-01-15 05:46:56.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427216&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:46:58.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768427218 status=200 resp_size=5211
|
||
2026-01-15 05:46:58.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427218&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12316
|
||
2026-01-15 05:47:07.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768427226 status=200 resp_size=5378
|
||
2026-01-15 05:47:07.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427227&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-15 05:47:09.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job×tamp=1768427229 status=200 resp_size=7299
|
||
2026-01-15 05:47:09.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427229&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
|
||
2026-01-15 05:47:18.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768427238 status=200 resp_size=6284
|
||
2026-01-15 05:47:19.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427238&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:47:19.145 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:47:25.746 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:47:25.761 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-15 05:47:27.257 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.49 秒后继续...
|
||
2026-01-15 05:47:27.257 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-15 05:47:27.257 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:47:27.286 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:47:27.913 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:47:29.059 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:47:31.196 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:47:31.196 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:47:31.746 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427247 status=200 resp_size=148203
|
||
2026-01-15 05:47:31.746 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:47:31.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768427251 status=200 resp_size=7262
|
||
2026-01-15 05:47:32.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427251&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 05:47:39.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768427258 status=200 resp_size=6343
|
||
2026-01-15 05:47:39.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427259&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-15 05:47:47.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768427266 status=200 resp_size=7967
|
||
2026-01-15 05:47:47.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427267&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-15 05:47:54.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768427273 status=200 resp_size=6254
|
||
2026-01-15 05:47:54.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427274&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:48:02.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768427281 status=200 resp_size=5253
|
||
2026-01-15 05:48:02.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427282&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 05:48:09.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768427288 status=200 resp_size=5431
|
||
2026-01-15 05:48:09.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427289&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 05:48:18.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768427297 status=200 resp_size=6080
|
||
2026-01-15 05:48:18.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427298&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 05:48:21.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768427301 status=200 resp_size=4995
|
||
2026-01-15 05:48:22.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427301&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:48:32.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768427311 status=200 resp_size=5936
|
||
2026-01-15 05:48:32.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427312&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-15 05:48:34.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768427314 status=200 resp_size=6041
|
||
2026-01-15 05:48:35.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427314&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-15 05:48:45.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768427323 status=200 resp_size=4916
|
||
2026-01-15 05:48:45.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427325&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-15 05:48:47.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768427327 status=200 resp_size=5446
|
||
2026-01-15 05:48:48.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427327&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-15 05:48:56.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768427335 status=200 resp_size=6494
|
||
2026-01-15 05:48:56.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427336&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-15 05:49:05.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768427344 status=200 resp_size=5860
|
||
2026-01-15 05:49:05.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427345&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:49:13.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768427352 status=200 resp_size=5677
|
||
2026-01-15 05:49:13.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427353&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-15 05:49:16.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768427355 status=200 resp_size=6226
|
||
2026-01-15 05:49:16.228 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427356&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-15 05:49:25.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768427364 status=200 resp_size=5613
|
||
2026-01-15 05:49:25.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427365&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 05:49:28.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768427368 status=200 resp_size=5792
|
||
2026-01-15 05:49:28.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427368&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:49:32.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768427371 status=200 resp_size=6422
|
||
2026-01-15 05:49:32.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427372&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-15 05:49:39.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768427379 status=200 resp_size=6176
|
||
2026-01-15 05:49:40.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427379&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-15 05:49:40.145 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:49:46.333 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:49:46.333 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-15 05:49:49.619 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.27 秒后继续...
|
||
2026-01-15 05:49:49.619 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-15 05:49:49.619 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:49:49.632 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:49:50.434 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:49:51.549 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:49:53.638 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:49:53.638 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:49:54.172 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427389 status=200 resp_size=147507
|
||
2026-01-15 05:49:54.172 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:49:54.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768427394 status=200 resp_size=7607
|
||
2026-01-15 05:49:54.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427394&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-15 05:50:02.606 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768427401 status=200 resp_size=6731
|
||
2026-01-15 05:50:02.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427402&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-15 05:50:06.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768427405 status=200 resp_size=5575
|
||
2026-01-15 05:50:07.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427406&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-15 05:50:16.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768427415 status=200 resp_size=5711
|
||
2026-01-15 05:50:16.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427416&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-15 05:50:20.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768427420 status=200 resp_size=6473
|
||
2026-01-15 05:50:20.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427420&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:50:29.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768427427 status=200 resp_size=6856
|
||
2026-01-15 05:50:29.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427429&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-15 05:50:34.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768427434 status=200 resp_size=5731
|
||
2026-01-15 05:50:34.659 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427434&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-15 05:50:37.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768427436 status=200 resp_size=7075
|
||
2026-01-15 05:50:37.375 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427437&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-15 05:50:41.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768427440 status=200 resp_size=6768
|
||
2026-01-15 05:50:41.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:50:50.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768427448 status=200 resp_size=6530
|
||
2026-01-15 05:50:50.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427450&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:51:00.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768427459 status=200 resp_size=8973
|
||
2026-01-15 05:51:00.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427460&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-15 05:51:04.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/129265631?api_key=51job×tamp=1768427464 status=200 resp_size=6315
|
||
2026-01-15 05:51:04.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427464&companyId=2033389&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9070
|
||
2026-01-15 05:51:13.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768427469 status=200 resp_size=8559
|
||
2026-01-15 05:51:14.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427473&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-15 05:51:24.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768427483 status=200 resp_size=6688
|
||
2026-01-15 05:51:24.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427484&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-15 05:51:25.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768427485 status=200 resp_size=5290
|
||
2026-01-15 05:51:26.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427485&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-15 05:51:36.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768427495 status=200 resp_size=5982
|
||
2026-01-15 05:51:36.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427496&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-15 05:51:38.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768427498 status=200 resp_size=7919
|
||
2026-01-15 05:51:38.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427498&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-15 05:51:43.177 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768427502 status=200 resp_size=7691
|
||
2026-01-15 05:51:43.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427503&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-15 05:51:44.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768427504 status=200 resp_size=5271
|
||
2026-01-15 05:51:44.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427504&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 05:51:48.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768427508 status=200 resp_size=7124
|
||
2026-01-15 05:51:48.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427508&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:51:48.845 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:51:55.080 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:51:55.080 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-15 05:52:03.299 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.21 秒后继续...
|
||
2026-01-15 05:52:03.299 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-15 05:52:03.299 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:52:03.313 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:52:03.878 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:52:04.996 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:52:07.139 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:52:07.139 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:52:07.641 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427523 status=200 resp_size=134766
|
||
2026-01-15 05:52:07.641 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:52:07.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768427527 status=200 resp_size=5686
|
||
2026-01-15 05:52:08.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427527&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-15 05:52:13.818 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768427533 status=200 resp_size=6660
|
||
2026-01-15 05:52:14.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427533&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-15 05:52:19.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768427539 status=200 resp_size=7952
|
||
2026-01-15 05:52:19.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427539&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-15 05:52:30.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768427549 status=200 resp_size=5414
|
||
2026-01-15 05:52:30.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427550&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:52:32.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768427551 status=200 resp_size=5277
|
||
2026-01-15 05:52:32.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427552&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-15 05:52:40.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768427560 status=200 resp_size=7175
|
||
2026-01-15 05:52:40.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427560&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-15 05:52:49.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768427568 status=200 resp_size=6284
|
||
2026-01-15 05:52:49.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427569&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:52:54.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768427573 status=200 resp_size=5672
|
||
2026-01-15 05:52:54.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427574&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-15 05:53:01.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768427580 status=200 resp_size=6168
|
||
2026-01-15 05:53:01.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427581&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-15 05:53:04.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170236222?api_key=51job×tamp=1768427584 status=200 resp_size=5943
|
||
2026-01-15 05:53:05.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427584&companyId=9964421&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3941
|
||
2026-01-15 05:53:08.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768427588 status=200 resp_size=5924
|
||
2026-01-15 05:53:09.054 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427588&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-15 05:53:13.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768427593 status=200 resp_size=6003
|
||
2026-01-15 05:53:13.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427593&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-15 05:53:17.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768427597 status=200 resp_size=5378
|
||
2026-01-15 05:53:17.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427597&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-15 05:53:26.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768427606 status=200 resp_size=5084
|
||
2026-01-15 05:53:27.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427606&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:53:28.936 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768427608 status=200 resp_size=9486
|
||
2026-01-15 05:53:29.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427608&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-15 05:53:30.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768427610 status=200 resp_size=5363
|
||
2026-01-15 05:53:31.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427610&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-15 05:53:38.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768427617 status=200 resp_size=13285
|
||
2026-01-15 05:53:38.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427618&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 05:53:49.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job×tamp=1768427628 status=200 resp_size=6873
|
||
2026-01-15 05:53:49.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427629&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:53:50.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768427630 status=200 resp_size=6041
|
||
2026-01-15 05:53:50.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427630&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-15 05:53:53.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768427632 status=200 resp_size=8734
|
||
2026-01-15 05:53:53.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427633&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-15 05:53:53.344 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:53:59.436 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:53:59.436 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-15 05:54:07.716 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.28 秒后继续...
|
||
2026-01-15 05:54:07.716 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-15 05:54:07.716 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:54:07.743 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:54:08.183 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:54:09.299 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:54:11.389 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:54:11.389 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:54:11.797 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427647 status=200 resp_size=129499
|
||
2026-01-15 05:54:11.797 | WARNING | __main__:get_recommend_jobs:745 - 第 12 页发现 1 个重复职位(已跳过)
|
||
2026-01-15 05:54:11.797 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位(去重后: 19) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:54:11.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768427651 status=200 resp_size=6635
|
||
2026-01-15 05:54:12.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427651&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-15 05:54:20.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156757939?api_key=51job×tamp=1768427659 status=200 resp_size=6205
|
||
2026-01-15 05:54:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427660&companyId=5542248&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3415
|
||
2026-01-15 05:54:24.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768427664 status=200 resp_size=5390
|
||
2026-01-15 05:54:24.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427664&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-15 05:54:32.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768427671 status=200 resp_size=8070
|
||
2026-01-15 05:54:32.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427672&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 05:54:36.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768427676 status=200 resp_size=6588
|
||
2026-01-15 05:54:37.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427676&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-15 05:54:44.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768427684 status=200 resp_size=6300
|
||
2026-01-15 05:54:44.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427684&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-15 05:54:48.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768427688 status=200 resp_size=7194
|
||
2026-01-15 05:54:49.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427688&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-15 05:54:58.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768427698 status=200 resp_size=6053
|
||
2026-01-15 05:54:59.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427698&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-15 05:55:07.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job×tamp=1768427707 status=200 resp_size=7170
|
||
2026-01-15 05:55:08.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427707&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 05:55:17.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768427716 status=200 resp_size=4992
|
||
2026-01-15 05:55:17.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427717&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-15 05:55:24.001 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768427723 status=200 resp_size=6073
|
||
2026-01-15 05:55:24.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427724&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:55:32.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768427731 status=200 resp_size=7194
|
||
2026-01-15 05:55:32.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427732&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-15 05:55:40.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job×tamp=1768427739 status=200 resp_size=6770
|
||
2026-01-15 05:55:40.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427740&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 05:55:43.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768427743 status=200 resp_size=5344
|
||
2026-01-15 05:55:43.506 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427743&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-15 05:55:53.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768427752 status=200 resp_size=5554
|
||
2026-01-15 05:55:53.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427753&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:55:56.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768427756 status=200 resp_size=5040
|
||
2026-01-15 05:55:56.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427756&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-15 05:56:03.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768427763 status=200 resp_size=4993
|
||
2026-01-15 05:56:04.176 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427763&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-15 05:56:07.286 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768427767 status=200 resp_size=6752
|
||
2026-01-15 05:56:07.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427767&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:56:14.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768427773 status=200 resp_size=5883
|
||
2026-01-15 05:56:14.856 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427774&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-15 05:56:14.856 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据,包含详细信息的数据条数: 19
|
||
2026-01-15 05:56:20.401 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-15 05:56:20.401 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-15 05:56:23.520 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.11 秒后继续...
|
||
2026-01-15 05:56:23.520 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-15 05:56:23.522 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:56:23.545 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:56:24.094 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:56:25.241 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:56:27.363 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:56:27.363 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:56:27.849 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427783 status=200 resp_size=142964
|
||
2026-01-15 05:56:27.849 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:56:28.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job×tamp=1768427787 status=200 resp_size=5688
|
||
2026-01-15 05:56:28.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427788&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-15 05:56:36.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768427795 status=200 resp_size=6980
|
||
2026-01-15 05:56:36.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427796&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-15 05:56:39.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job×tamp=1768427799 status=200 resp_size=6794
|
||
2026-01-15 05:56:39.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427799&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-15 05:56:47.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768427806 status=200 resp_size=5283
|
||
2026-01-15 05:56:47.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427807&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-15 05:56:49.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job×tamp=1768427809 status=200 resp_size=5215
|
||
2026-01-15 05:56:50.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427809&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
|
||
2026-01-15 05:56:53.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768427813 status=200 resp_size=5764
|
||
2026-01-15 05:56:53.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427813&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:56:56.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768427816 status=200 resp_size=5514
|
||
2026-01-15 05:56:56.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427816&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-15 05:57:01.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768427821 status=200 resp_size=6659
|
||
2026-01-15 05:57:01.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427821&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:57:09.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169946122?api_key=51job×tamp=1768427828 status=200 resp_size=5165
|
||
2026-01-15 05:57:09.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427829&companyId=10103470&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3252
|
||
2026-01-15 05:57:15.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768427834 status=200 resp_size=6856
|
||
2026-01-15 05:57:15.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427835&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-15 05:57:23.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867711?api_key=51job×tamp=1768427842 status=200 resp_size=5570
|
||
2026-01-15 05:57:23.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427843&companyId=5203710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11092
|
||
2026-01-15 05:57:32.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241609?api_key=51job×tamp=1768427851 status=200 resp_size=6749
|
||
2026-01-15 05:57:32.517 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427852&companyId=303117&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=16199
|
||
2026-01-15 05:57:41.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768427860 status=200 resp_size=5688
|
||
2026-01-15 05:57:41.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427861&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-15 05:57:48.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768427868 status=200 resp_size=6380
|
||
2026-01-15 05:57:49.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427868&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-15 05:57:55.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768427874 status=200 resp_size=7975
|
||
2026-01-15 05:57:55.634 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427875&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-15 05:57:59.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768427879 status=200 resp_size=5984
|
||
2026-01-15 05:57:59.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427879&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-15 05:58:05.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768427885 status=200 resp_size=7274
|
||
2026-01-15 05:58:06.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427885&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-15 05:58:11.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768427891 status=200 resp_size=5582
|
||
2026-01-15 05:58:12.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427891&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-15 05:58:14.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768427894 status=200 resp_size=5924
|
||
2026-01-15 05:58:14.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427894&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-15 05:58:24.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768427903 status=200 resp_size=6027
|
||
2026-01-15 05:58:24.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427904&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-15 05:58:24.443 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 05:58:30.508 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 05:58:30.508 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-15 05:58:38.599 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.08 秒后继续...
|
||
2026-01-15 05:58:38.599 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-15 05:58:38.599 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 05:58:38.629 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 05:58:39.209 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:58:40.354 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:58:42.490 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 05:58:42.490 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 05:58:42.993 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768427918 status=200 resp_size=163509
|
||
2026-01-15 05:58:42.993 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 05:58:43.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163639864?api_key=51job×tamp=1768427923 status=200 resp_size=6028
|
||
2026-01-15 05:58:43.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427923&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 05:58:46.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170245865?api_key=51job×tamp=1768427926 status=200 resp_size=4774
|
||
2026-01-15 05:58:47.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427926&companyId=2307066&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4098
|
||
2026-01-15 05:58:51.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768427931 status=200 resp_size=8782
|
||
2026-01-15 05:58:51.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427931&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-15 05:58:55.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768427935 status=200 resp_size=8655
|
||
2026-01-15 05:58:55.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427935&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-15 05:58:59.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job×tamp=1768427939 status=200 resp_size=6935
|
||
2026-01-15 05:58:59.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427939&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
|
||
2026-01-15 05:59:07.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768427946 status=200 resp_size=6440
|
||
2026-01-15 05:59:07.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427947&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-15 05:59:14.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768427953 status=200 resp_size=7907
|
||
2026-01-15 05:59:14.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427954&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-15 05:59:23.482 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169978093?api_key=51job×tamp=1768427962 status=200 resp_size=4592
|
||
2026-01-15 05:59:23.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427963&companyId=6518056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5922
|
||
2026-01-15 05:59:27.407 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768427967 status=200 resp_size=5878
|
||
2026-01-15 05:59:27.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427967&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-15 05:59:33.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768427973 status=200 resp_size=6437
|
||
2026-01-15 05:59:33.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427973&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-15 05:59:41.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768427981 status=200 resp_size=5672
|
||
2026-01-15 05:59:41.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427981&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-15 05:59:49.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248997?api_key=51job×tamp=1768427989 status=200 resp_size=5463
|
||
2026-01-15 05:59:50.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427989&companyId=8942798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18995
|
||
2026-01-15 05:59:56.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job×tamp=1768427995 status=200 resp_size=5448
|
||
2026-01-15 05:59:56.650 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768427996&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-15 06:00:02.902 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768428002 status=200 resp_size=9108
|
||
2026-01-15 06:00:03.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428002&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-15 06:00:12.529 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768428011 status=200 resp_size=6111
|
||
2026-01-15 06:00:12.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428012&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6966
|
||
2026-01-15 06:00:15.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768428014 status=200 resp_size=6617
|
||
2026-01-15 06:00:15.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428015&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-15 06:00:22.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768428021 status=200 resp_size=7313
|
||
2026-01-15 06:00:23.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428022&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-15 06:00:26.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768428026 status=200 resp_size=6958
|
||
2026-01-15 06:00:26.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428026&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-15 06:00:29.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768428029 status=200 resp_size=6694
|
||
2026-01-15 06:00:29.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428029&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14345
|
||
2026-01-15 06:00:38.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768428037 status=200 resp_size=6568
|
||
2026-01-15 06:00:38.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428038&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-15 06:00:38.558 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据,包含详细信息的数据条数: 20
|
||
2026-01-15 06:00:45.090 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-15 06:00:45.091 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-15 06:00:52.330 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.24 秒后继续...
|
||
2026-01-15 06:00:52.331 | INFO | __main__:crawl_multiple_pages:1005 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-15 06:00:52.331 | INFO | __main__:_init_client:416 - 初始化客户端,使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-15 06:00:52.355 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=沈阳, 工作类型=1332
|
||
2026-01-15 06:00:52.950 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 06:00:54.085 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 06:00:56.247 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时,请稍后重试!"}
|
||
2026-01-15 06:00:56.247 | ERROR | __main__:_make_request:645 - 所有重试失败,请求终止
|
||
2026-01-15 06:00:56.805 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768428052 status=200 resp_size=128123
|
||
2026-01-15 06:00:56.806 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位(去重后: 20) | API返回totalCount: 517 (原始值: 517) | 地区: 沈阳(沈阳) | 职能: 防疫员(1332)
|
||
2026-01-15 06:00:57.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768428056 status=200 resp_size=5922
|
||
2026-01-15 06:00:57.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768428057&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-15 06:00:58.834 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
|
||
2026-01-15 06:00:58.836 | INFO | __main__:close:1137 - httpx客户端已关闭
|