1896 lines
395 KiB
Plaintext
1896 lines
395 KiB
Plaintext
2026-01-14 20:43:30.893 | INFO | __main__:crawl_recommend_jobs_main:1168 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:43:30.942 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:43:31.205 | INFO | __main__:crawl_recommend_jobs_main:1202 - 开始爬取推荐职位，最多 50 页
|
||
2026-01-14 20:43:31.205 | INFO | __main__:crawl_multiple_pages:998 - ================================================================================
|
||
2026-01-14 20:43:31.205 | INFO | __main__:crawl_multiple_pages:999 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:43:31.205 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-14 20:43:31.205 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-14 20:43:31.206 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:43:31.215 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=1, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:43:31.963 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:43:33.175 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:43:35.416 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:43:35.416 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:43:35.985 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768394611 status=200 resp_size=113347
|
||
2026-01-14 20:43:35.985 | INFO | __main__:get_recommend_jobs:745 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:43:36.226 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768394615 status=200 resp_size=5029
|
||
2026-01-14 20:43:36.426 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394616&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-14 20:43:45.854 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768394624 status=200 resp_size=5589
|
||
2026-01-14 20:43:46.111 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394625&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:43:53.541 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768394632 status=200 resp_size=5194
|
||
2026-01-14 20:43:53.993 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394633&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:44:01.518 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768394639 status=200 resp_size=5556
|
||
2026-01-14 20:44:01.736 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394641&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:44:11.143 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170271546?api_key=51job×tamp=1768394650 status=200 resp_size=5864
|
||
2026-01-14 20:44:11.308 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394651&companyId=10151561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2689
|
||
2026-01-14 20:44:15.689 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768394655 status=200 resp_size=5022
|
||
2026-01-14 20:44:15.859 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394655&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-14 20:44:17.869 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768394657 status=200 resp_size=5640
|
||
2026-01-14 20:44:18.054 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394657&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:44:29.753 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job×tamp=1768394667 status=200 resp_size=6609
|
||
2026-01-14 20:44:29.992 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394669&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
|
||
2026-01-14 20:44:35.912 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170263138?api_key=51job×tamp=1768394675 status=200 resp_size=6660
|
||
2026-01-14 20:44:36.133 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394675&companyId=10152513&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6465
|
||
2026-01-14 20:44:40.631 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768394680 status=200 resp_size=5769
|
||
2026-01-14 20:44:40.894 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394680&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-14 20:44:46.957 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768394685 status=200 resp_size=6192
|
||
2026-01-14 20:44:47.319 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394686&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 20:44:59.311 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768394695 status=200 resp_size=5738
|
||
2026-01-14 20:44:59.531 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394699&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 20:45:10.003 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768394709 status=200 resp_size=6481
|
||
2026-01-14 20:45:10.230 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394710&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:45:19.004 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768394716 status=200 resp_size=6210
|
||
2026-01-14 20:45:19.291 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394719&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-14 20:45:28.023 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768394727 status=200 resp_size=5846
|
||
2026-01-14 20:45:28.219 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394728&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:45:31.674 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768394731 status=200 resp_size=4921
|
||
2026-01-14 20:45:31.854 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394731&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-14 20:45:38.552 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768394737 status=200 resp_size=6188
|
||
2026-01-14 20:45:38.778 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394738&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-14 20:45:48.606 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768394747 status=200 resp_size=5466
|
||
2026-01-14 20:45:48.822 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394748&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-14 20:45:56.979 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768394756 status=200 resp_size=5979
|
||
2026-01-14 20:45:57.199 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394756&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:45:59.309 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768394759 status=200 resp_size=6004
|
||
2026-01-14 20:45:59.523 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394759&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:45:59.524 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 20:45:59.860 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 20:45:59.861 | INFO | __main__:crawl_multiple_pages:1025 - 检测到API返回totalCount: 508 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-14 20:45:59.861 | INFO | __main__:crawl_multiple_pages:1029 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-14 20:46:09.702 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 9.84 秒后继续...
|
||
2026-01-14 20:46:09.703 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-14 20:46:09.704 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:46:09.729 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=2, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:46:10.606 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:46:11.826 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:46:14.026 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:46:14.026 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:46:14.577 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768394769 status=200 resp_size=107679
|
||
2026-01-14 20:46:14.577 | INFO | __main__:get_recommend_jobs:745 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:46:14.831 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768394774 status=200 resp_size=4913
|
||
2026-01-14 20:46:15.069 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394774&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-14 20:46:22.897 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768394782 status=200 resp_size=5679
|
||
2026-01-14 20:46:23.119 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394782&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 20:46:26.650 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768394786 status=200 resp_size=5737
|
||
2026-01-14 20:46:26.876 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394786&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-14 20:46:35.018 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768394794 status=200 resp_size=5585
|
||
2026-01-14 20:46:35.187 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394795&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 20:46:37.623 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768394797 status=200 resp_size=6051
|
||
2026-01-14 20:46:37.801 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394797&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:46:47.622 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768394806 status=200 resp_size=6332
|
||
2026-01-14 20:46:47.853 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394807&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-14 20:46:52.011 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768394811 status=200 resp_size=5502
|
||
2026-01-14 20:46:53.311 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394812&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-14 20:46:59.900 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768394819 status=200 resp_size=5196
|
||
2026-01-14 20:47:00.133 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394819&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-14 20:47:09.398 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170264772?api_key=51job×tamp=1768394828 status=200 resp_size=6220
|
||
2026-01-14 20:47:09.627 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394829&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 20:47:12.862 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768394832 status=200 resp_size=6134
|
||
2026-01-14 20:47:13.087 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394832&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-14 20:47:14.385 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768394834 status=200 resp_size=5612
|
||
2026-01-14 20:47:14.600 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394834&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-14 20:47:16.485 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768394836 status=200 resp_size=5128
|
||
2026-01-14 20:47:16.699 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394836&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-14 20:47:19.823 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768394839 status=200 resp_size=6579
|
||
2026-01-14 20:47:20.044 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394839&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 20:47:25.895 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768394845 status=200 resp_size=5975
|
||
2026-01-14 20:47:26.069 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394845&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-14 20:47:27.723 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768394847 status=200 resp_size=5623
|
||
2026-01-14 20:47:27.910 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394847&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 20:47:35.103 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768394854 status=200 resp_size=5330
|
||
2026-01-14 20:47:35.300 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394855&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:47:36.566 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768394856 status=200 resp_size=5708
|
||
2026-01-14 20:47:36.733 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394856&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:47:43.793 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768394863 status=200 resp_size=5490
|
||
2026-01-14 20:47:43.992 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394863&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-14 20:47:46.563 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768394866 status=200 resp_size=5612
|
||
2026-01-14 20:47:46.775 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394866&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 20:47:49.324 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768394869 status=200 resp_size=5704
|
||
2026-01-14 20:47:49.506 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394869&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 20:47:49.507 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 20:47:49.638 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 20:47:49.639 | INFO | __main__:crawl_multiple_pages:1029 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-14 20:47:56.982 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 7.34 秒后继续...
|
||
2026-01-14 20:47:56.983 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-14 20:47:56.985 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:47:57.005 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=3, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:47:58.658 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:47:59.829 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:48:01.973 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:48:01.974 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:48:02.400 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768394877 status=200 resp_size=106240
|
||
2026-01-14 20:48:02.401 | INFO | __main__:get_recommend_jobs:745 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:48:02.653 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170261099?api_key=51job×tamp=1768394882 status=200 resp_size=6148
|
||
2026-01-14 20:48:02.843 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394882&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 20:48:05.688 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768394885 status=200 resp_size=5516
|
||
2026-01-14 20:48:05.892 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394885&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 20:48:14.721 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768394894 status=200 resp_size=6076
|
||
2026-01-14 20:48:14.905 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394894&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 20:48:18.633 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768394897 status=200 resp_size=5665
|
||
2026-01-14 20:48:18.835 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394898&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-14 20:48:27.008 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768394906 status=200 resp_size=8600
|
||
2026-01-14 20:48:27.251 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394907&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 20:48:34.486 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768394913 status=200 resp_size=5531
|
||
2026-01-14 20:48:34.713 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394914&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-14 20:48:44.759 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768394924 status=200 resp_size=6312
|
||
2026-01-14 20:48:44.952 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394924&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-14 20:48:55.444 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768394934 status=200 resp_size=5127
|
||
2026-01-14 20:48:55.685 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394935&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-14 20:49:03.096 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768394942 status=200 resp_size=6979
|
||
2026-01-14 20:49:03.287 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394943&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:49:11.770 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768394951 status=200 resp_size=5202
|
||
2026-01-14 20:49:11.963 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394951&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-14 20:49:21.097 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768394960 status=200 resp_size=5998
|
||
2026-01-14 20:49:21.305 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394961&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-14 20:49:22.755 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768394962 status=200 resp_size=5342
|
||
2026-01-14 20:49:22.973 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394962&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 20:49:24.554 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768394964 status=200 resp_size=7065
|
||
2026-01-14 20:49:24.775 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394964&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-14 20:49:26.579 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768394966 status=200 resp_size=5734
|
||
2026-01-14 20:49:26.825 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394966&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 20:49:32.916 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768394972 status=200 resp_size=5685
|
||
2026-01-14 20:49:33.077 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394972&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:49:34.584 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768394974 status=200 resp_size=5244
|
||
2026-01-14 20:49:34.759 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394974&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 20:49:45.454 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768394984 status=200 resp_size=6451
|
||
2026-01-14 20:49:45.658 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394985&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-14 20:49:51.776 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768394991 status=200 resp_size=5733
|
||
2026-01-14 20:49:51.953 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394991&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 20:49:59.794 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768394999 status=200 resp_size=6030
|
||
2026-01-14 20:49:59.983 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768394999&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-14 20:50:04.610 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768395004 status=200 resp_size=5201
|
||
2026-01-14 20:50:04.809 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395004&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:50:04.809 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 20:50:04.939 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 20:50:04.940 | INFO | __main__:crawl_multiple_pages:1029 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-14 20:50:14.811 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 9.87 秒后继续...
|
||
2026-01-14 20:50:14.815 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-14 20:50:14.815 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:50:14.837 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=4, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:50:15.564 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:50:16.757 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:50:18.965 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:50:18.965 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:50:19.487 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395014 status=200 resp_size=114867
|
||
2026-01-14 20:50:19.488 | INFO | __main__:get_recommend_jobs:745 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:50:19.721 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768395019 status=200 resp_size=5134
|
||
2026-01-14 20:50:19.934 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395019&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 20:50:22.289 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768395022 status=200 resp_size=6657
|
||
2026-01-14 20:50:22.500 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395022&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 20:50:26.971 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768395026 status=200 resp_size=5827
|
||
2026-01-14 20:50:27.198 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395026&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:50:30.523 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768395030 status=200 resp_size=6454
|
||
2026-01-14 20:50:30.741 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395030&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 20:50:35.185 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768395034 status=200 resp_size=6535
|
||
2026-01-14 20:50:35.415 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395035&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 20:50:40.560 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768395040 status=200 resp_size=6487
|
||
2026-01-14 20:50:40.768 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395040&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 20:50:47.895 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768395047 status=200 resp_size=5787
|
||
2026-01-14 20:50:48.121 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395047&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:50:49.500 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768395049 status=200 resp_size=5824
|
||
2026-01-14 20:50:49.711 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395049&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 20:51:01.107 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768395059 status=200 resp_size=6558
|
||
2026-01-14 20:51:01.356 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395061&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:51:10.351 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768395069 status=200 resp_size=5961
|
||
2026-01-14 20:51:10.567 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395070&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:51:15.058 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768395074 status=200 resp_size=6398
|
||
2026-01-14 20:51:15.286 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395075&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 20:51:23.563 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768395082 status=200 resp_size=6043
|
||
2026-01-14 20:51:23.749 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395083&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:51:32.026 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768395091 status=200 resp_size=7146
|
||
2026-01-14 20:51:32.259 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395092&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 20:51:34.095 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768395093 status=200 resp_size=6523
|
||
2026-01-14 20:51:34.332 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395094&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 20:51:35.969 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768395095 status=200 resp_size=5934
|
||
2026-01-14 20:51:36.200 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395095&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:51:41.066 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768395100 status=200 resp_size=4088
|
||
2026-01-14 20:51:41.328 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395101&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-14 20:51:44.289 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768395104 status=200 resp_size=5898
|
||
2026-01-14 20:51:44.522 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395104&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-14 20:51:50.652 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768395109 status=200 resp_size=6191
|
||
2026-01-14 20:51:50.858 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395110&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 20:51:56.788 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768395116 status=200 resp_size=5226
|
||
2026-01-14 20:51:56.982 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395116&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:51:59.322 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768395119 status=200 resp_size=6146
|
||
2026-01-14 20:51:59.518 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395119&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 20:51:59.518 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 20:51:59.658 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 20:51:59.658 | INFO | __main__:crawl_multiple_pages:1029 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-14 20:52:09.115 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 9.45 秒后继续...
|
||
2026-01-14 20:52:09.116 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-14 20:52:09.117 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:52:09.142 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=5, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:52:10.034 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:52:11.256 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:52:13.470 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:52:13.470 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:52:14.044 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395129 status=200 resp_size=138484
|
||
2026-01-14 20:52:14.047 | WARNING | __main__:get_recommend_jobs:743 - 第 5 页发现 3 个重复职位（已跳过）
|
||
2026-01-14 20:52:14.048 | INFO | __main__:get_recommend_jobs:745 - 第 5 页成功获取 20 个职位（去重后: 17） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:52:14.303 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768395134 status=200 resp_size=6069
|
||
2026-01-14 20:52:14.560 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395134&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 20:52:26.520 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768395144 status=200 resp_size=5628
|
||
2026-01-14 20:52:27.190 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395146&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:52:32.474 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768395152 status=200 resp_size=5476
|
||
2026-01-14 20:52:32.839 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395152&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 20:52:45.066 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768395162 status=200 resp_size=5518
|
||
2026-01-14 20:52:45.360 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395165&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:52:53.651 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768395172 status=200 resp_size=5882
|
||
2026-01-14 20:52:53.885 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395173&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 20:52:58.359 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768395178 status=200 resp_size=7564
|
||
2026-01-14 20:52:58.600 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395178&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-14 20:53:01.652 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170272059?api_key=51job×tamp=1768395181 status=200 resp_size=5534
|
||
2026-01-14 20:53:01.894 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395181&companyId=7148533&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6045
|
||
2026-01-14 20:53:14.842 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768395191 status=200 resp_size=6270
|
||
2026-01-14 20:53:15.197 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395194&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:53:21.598 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768395201 status=200 resp_size=5994
|
||
2026-01-14 20:53:21.721 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395201&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 20:53:23.376 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768395203 status=200 resp_size=6206
|
||
2026-01-14 20:53:23.520 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395203&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-14 20:53:30.581 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768395208 status=200 resp_size=5524
|
||
2026-01-14 20:53:30.975 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395210&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-14 20:53:34.667 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768395214 status=200 resp_size=6451
|
||
2026-01-14 20:53:34.833 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395214&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:53:37.988 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768395217 status=200 resp_size=7775
|
||
2026-01-14 20:53:38.189 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395217&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 20:53:43.026 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768395222 status=200 resp_size=5695
|
||
2026-01-14 20:53:43.226 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395223&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-14 20:53:52.308 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768395231 status=200 resp_size=6336
|
||
2026-01-14 20:53:52.558 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395232&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-14 20:53:59.139 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768395238 status=200 resp_size=5764
|
||
2026-01-14 20:53:59.327 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395239&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:54:06.922 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768395246 status=200 resp_size=7321
|
||
2026-01-14 20:54:07.281 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395246&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-14 20:54:07.282 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 5 页数据，包含详细信息的数据条数: 17
|
||
2026-01-14 20:54:07.427 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
|
||
2026-01-14 20:54:07.428 | INFO | __main__:crawl_multiple_pages:1029 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-14 20:54:11.269 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 3.84 秒后继续...
|
||
2026-01-14 20:54:11.270 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-14 20:54:11.270 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:54:11.292 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=6, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:54:12.352 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:54:13.569 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:54:15.787 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:54:15.787 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:54:16.339 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395251 status=200 resp_size=141631
|
||
2026-01-14 20:54:16.340 | INFO | __main__:get_recommend_jobs:745 - 第 6 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:54:16.619 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768395256 status=200 resp_size=7521
|
||
2026-01-14 20:54:16.880 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395256&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-14 20:54:24.915 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768395264 status=200 resp_size=6449
|
||
2026-01-14 20:54:25.101 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395264&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-14 20:54:31.660 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768395270 status=200 resp_size=5990
|
||
2026-01-14 20:54:31.917 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395271&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:54:41.841 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768395281 status=200 resp_size=8382
|
||
2026-01-14 20:54:42.034 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395281&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-14 20:54:45.682 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768395285 status=200 resp_size=6428
|
||
2026-01-14 20:54:45.941 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395285&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-14 20:54:53.144 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768395292 status=200 resp_size=5894
|
||
2026-01-14 20:54:53.291 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395293&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 20:54:57.050 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768395296 status=200 resp_size=5438
|
||
2026-01-14 20:54:57.200 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395297&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:55:04.471 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768395303 status=200 resp_size=5652
|
||
2026-01-14 20:55:04.722 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395304&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-14 20:55:12.926 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768395312 status=200 resp_size=6287
|
||
2026-01-14 20:55:13.180 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395312&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-14 20:55:24.591 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768395322 status=200 resp_size=5855
|
||
2026-01-14 20:55:25.006 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395324&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:55:31.368 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768395330 status=200 resp_size=6031
|
||
2026-01-14 20:55:32.849 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395331&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-14 20:55:42.182 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768395341 status=200 resp_size=6874
|
||
2026-01-14 20:55:42.422 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395342&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-14 20:55:48.550 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768395347 status=200 resp_size=7105
|
||
2026-01-14 20:55:48.814 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395348&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-14 20:56:02.206 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768395354 status=200 resp_size=6523
|
||
2026-01-14 20:56:03.817 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395362&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:56:08.661 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768395368 status=200 resp_size=6731
|
||
2026-01-14 20:56:08.953 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395368&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-14 20:56:18.977 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768395377 status=200 resp_size=6739
|
||
2026-01-14 20:56:19.207 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395378&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-14 20:56:27.769 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768395386 status=200 resp_size=5863
|
||
2026-01-14 20:56:27.983 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395387&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-14 20:56:32.022 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768395391 status=200 resp_size=6133
|
||
2026-01-14 20:56:32.239 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395392&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:56:37.150 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768395396 status=200 resp_size=5241
|
||
2026-01-14 20:56:37.392 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395397&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12319
|
||
2026-01-14 20:56:40.059 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768395399 status=200 resp_size=5964
|
||
2026-01-14 20:56:40.256 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395400&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 20:56:40.256 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 6 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 20:56:46.483 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 20:56:46.485 | INFO | __main__:crawl_multiple_pages:1029 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-14 20:56:53.549 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 7.06 秒后继续...
|
||
2026-01-14 20:56:53.549 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-14 20:56:53.550 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:56:53.574 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=7, 页大小=20, 地区=潮州, 工作类型=8703
|
||
2026-01-14 20:56:54.354 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:56:55.542 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:56:57.756 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:56:57.758 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:56:58.275 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395413 status=200 resp_size=159596
|
||
2026-01-14 20:56:58.276 | WARNING | __main__:get_recommend_jobs:743 - 第 7 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 20:56:58.276 | INFO | __main__:get_recommend_jobs:745 - 第 7 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 潮州(潮州) | 职能: 化妆品产品经理(8703)
|
||
2026-01-14 20:56:58.488 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768395418 status=200 resp_size=5806
|
||
2026-01-14 20:56:58.712 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395418&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 20:57:01.424 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768395421 status=200 resp_size=5433
|
||
2026-01-14 20:57:01.640 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395421&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:57:12.429 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768395431 status=200 resp_size=7211
|
||
2026-01-14 20:57:12.702 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395432&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-14 20:57:20.460 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768395439 status=200 resp_size=7292
|
||
2026-01-14 20:57:20.650 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395440&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 20:57:38.427 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768395449 status=200 resp_size=6361
|
||
2026-01-14 20:57:38.849 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395458&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-14 20:57:41.501 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768395460 status=200 resp_size=6407
|
||
2026-01-14 20:57:41.766 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395461&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 20:57:49.982 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768395469 status=200 resp_size=5635
|
||
2026-01-14 20:57:50.149 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395469&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-14 20:57:56.357 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768395475 status=200 resp_size=5682
|
||
2026-01-14 20:57:56.554 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395476&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-14 20:57:58.308 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768395478 status=200 resp_size=7975
|
||
2026-01-14 20:57:58.497 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395478&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-14 20:58:00.996 | INFO | __main__:crawl_recommend_jobs_main:1221 - 用户中断推荐职位爬取
|
||
2026-01-14 20:58:00.997 | INFO | __main__:close:1135 - httpx客户端已关闭
|
||
2026-01-14 20:58:02.916 | INFO | __main__:crawl_recommend_jobs_main:1168 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:58:02.960 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:58:03.116 | INFO | __main__:crawl_recommend_jobs_main:1202 - 开始爬取推荐职位，最多 50 页
|
||
2026-01-14 20:58:03.117 | INFO | __main__:crawl_multiple_pages:998 - ================================================================================
|
||
2026-01-14 20:58:03.117 | INFO | __main__:crawl_multiple_pages:999 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 宿迁(宿迁) | 职能: 房地产销售经理/主管(6009)
|
||
2026-01-14 20:58:03.117 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-14 20:58:03.117 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-14 20:58:03.117 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 20:58:03.129 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=1, 页大小=20, 地区=宿迁, 工作类型=6009
|
||
2026-01-14 20:58:03.665 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:58:04.807 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:58:06.942 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 20:58:06.943 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 20:58:07.332 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395483 status=200 resp_size=111407
|
||
2026-01-14 20:58:07.332 | INFO | __main__:get_recommend_jobs:745 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿迁(宿迁) | 职能: 房地产销售经理/主管(6009)
|
||
2026-01-14 20:58:07.494 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170273603?api_key=51job×tamp=1768395487 status=200 resp_size=5711
|
||
2026-01-14 20:58:07.670 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395487&companyId=10152956&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2648
|
||
2026-01-14 20:58:18.320 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768395497 status=200 resp_size=5589
|
||
2026-01-14 20:58:18.507 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395498&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:58:27.437 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768395506 status=200 resp_size=5194
|
||
2026-01-14 20:58:27.597 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395507&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:58:30.575 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768395510 status=200 resp_size=5556
|
||
2026-01-14 20:58:30.739 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395510&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:58:40.685 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768395520 status=200 resp_size=5029
|
||
2026-01-14 20:58:40.837 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395520&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-14 20:58:45.617 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768395525 status=200 resp_size=5022
|
||
2026-01-14 20:58:45.787 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395525&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-14 20:58:53.270 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768395532 status=200 resp_size=5640
|
||
2026-01-14 20:58:53.436 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395533&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 20:59:01.299 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768395540 status=200 resp_size=5769
|
||
2026-01-14 20:59:01.548 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395541&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-14 20:59:10.619 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170271546?api_key=51job×tamp=1768395549 status=200 resp_size=5864
|
||
2026-01-14 20:59:10.815 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395550&companyId=10151561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2689
|
||
2026-01-14 20:59:18.662 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768395557 status=200 resp_size=6192
|
||
2026-01-14 20:59:18.919 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395558&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 20:59:20.418 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768395560 status=200 resp_size=5738
|
||
2026-01-14 20:59:20.669 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395560&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 20:59:33.861 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768395569 status=200 resp_size=6210
|
||
2026-01-14 20:59:34.200 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395573&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-14 20:59:41.562 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170263138?api_key=51job×tamp=1768395580 status=200 resp_size=6660
|
||
2026-01-14 20:59:41.803 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395581&companyId=10152513&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6465
|
||
2026-01-14 20:59:46.599 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768395586 status=200 resp_size=5888
|
||
2026-01-14 20:59:46.832 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395586&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 20:59:49.718 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768395589 status=200 resp_size=4921
|
||
2026-01-14 20:59:49.917 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395589&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-14 20:59:53.306 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768395593 status=200 resp_size=5466
|
||
2026-01-14 20:59:53.492 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395593&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-14 21:00:00.946 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768395600 status=200 resp_size=6483
|
||
2026-01-14 21:00:01.150 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395600&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:00:06.256 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768395606 status=200 resp_size=6021
|
||
2026-01-14 21:00:06.457 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395606&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:00:15.908 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768395615 status=200 resp_size=6046
|
||
2026-01-14 21:00:16.050 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395615&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:00:25.932 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768395625 status=200 resp_size=5679
|
||
2026-01-14 21:00:26.183 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395625&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:00:26.183 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:00:26.313 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:00:26.314 | INFO | __main__:crawl_multiple_pages:1025 - 检测到API返回totalCount: 508 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-14 21:00:26.314 | INFO | __main__:crawl_multiple_pages:1029 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-14 21:00:33.095 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 6.78 秒后继续...
|
||
2026-01-14 21:00:33.095 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-14 21:00:33.096 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:00:33.120 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=2, 页大小=20, 地区=宿迁, 工作类型=6009
|
||
2026-01-14 21:00:33.667 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:00:34.799 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:00:36.928 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:00:36.928 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:00:37.373 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395633 status=200 resp_size=107513
|
||
2026-01-14 21:00:37.373 | INFO | __main__:get_recommend_jobs:745 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿迁(宿迁) | 职能: 房地产销售经理/主管(6009)
|
||
2026-01-14 21:00:37.553 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768395637 status=200 resp_size=6546
|
||
2026-01-14 21:00:37.730 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395637&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:00:40.205 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768395640 status=200 resp_size=5739
|
||
2026-01-14 21:00:40.368 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395640&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-14 21:00:48.060 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768395647 status=200 resp_size=5585
|
||
2026-01-14 21:00:48.188 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395648&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:00:54.450 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768395653 status=200 resp_size=6332
|
||
2026-01-14 21:00:55.146 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395654&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-14 21:00:57.924 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768395657 status=200 resp_size=4913
|
||
2026-01-14 21:00:58.381 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395657&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-14 21:01:06.148 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768395663 status=200 resp_size=5502
|
||
2026-01-14 21:01:06.469 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395666&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-14 21:01:11.530 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768395671 status=200 resp_size=5196
|
||
2026-01-14 21:01:11.791 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395671&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-14 21:01:12.252 | INFO | __main__:crawl_recommend_jobs_main:1221 - 用户中断推荐职位爬取
|
||
2026-01-14 21:01:12.253 | INFO | __main__:close:1135 - httpx客户端已关闭
|
||
2026-01-14 21:01:16.214 | INFO | __main__:crawl_recommend_jobs_main:1168 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:01:16.259 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:01:16.455 | INFO | __main__:crawl_recommend_jobs_main:1202 - 开始爬取推荐职位，最多 50 页
|
||
2026-01-14 21:01:16.455 | INFO | __main__:crawl_multiple_pages:998 - ================================================================================
|
||
2026-01-14 21:01:16.455 | INFO | __main__:crawl_multiple_pages:999 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:01:16.455 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
|
||
2026-01-14 21:01:16.455 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-14 21:01:16.455 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:01:16.471 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=1, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:01:17.302 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:01:18.513 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:01:20.691 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:01:20.691 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:01:21.162 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395676 status=200 resp_size=112491
|
||
2026-01-14 21:01:21.162 | INFO | __main__:get_recommend_jobs:745 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:01:21.393 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768395681 status=200 resp_size=5029
|
||
2026-01-14 21:01:21.602 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395681&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-14 21:01:30.414 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768395689 status=200 resp_size=5589
|
||
2026-01-14 21:01:30.668 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395690&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:01:40.693 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768395699 status=200 resp_size=5194
|
||
2026-01-14 21:01:40.972 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395700&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:01:50.297 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768395709 status=200 resp_size=5556
|
||
2026-01-14 21:01:50.549 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395710&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:01:59.308 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170271546?api_key=51job×tamp=1768395718 status=200 resp_size=5864
|
||
2026-01-14 21:01:59.543 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395719&companyId=10151561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2689
|
||
2026-01-14 21:02:08.023 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768395727 status=200 resp_size=5022
|
||
2026-01-14 21:02:08.198 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395728&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-14 21:02:09.779 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768395729 status=200 resp_size=5640
|
||
2026-01-14 21:02:09.993 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395729&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:02:22.706 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768395739 status=200 resp_size=5769
|
||
2026-01-14 21:02:22.949 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395742&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-14 21:02:28.836 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170263138?api_key=51job×tamp=1768395748 status=200 resp_size=6660
|
||
2026-01-14 21:02:29.029 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395748&companyId=10152513&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6465
|
||
2026-01-14 21:02:35.580 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768395755 status=200 resp_size=6192
|
||
2026-01-14 21:02:35.713 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395755&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 21:02:46.059 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768395765 status=200 resp_size=5738
|
||
2026-01-14 21:02:46.225 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395766&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:02:48.119 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768395767 status=200 resp_size=6210
|
||
2026-01-14 21:02:48.283 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395768&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-14 21:02:56.688 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768395776 status=200 resp_size=6483
|
||
2026-01-14 21:02:56.845 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395776&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:02:59.788 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768395779 status=200 resp_size=5888
|
||
2026-01-14 21:02:59.929 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395779&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:03:08.565 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768395788 status=200 resp_size=4916
|
||
2026-01-14 21:03:08.713 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395788&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-14 21:03:14.657 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768395793 status=200 resp_size=5466
|
||
2026-01-14 21:03:14.915 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395794&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-14 21:03:19.019 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768395798 status=200 resp_size=6546
|
||
2026-01-14 21:03:19.284 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395799&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:03:23.362 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768395803 status=200 resp_size=6021
|
||
2026-01-14 21:03:23.613 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395803&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:03:31.996 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768395811 status=200 resp_size=6046
|
||
2026-01-14 21:03:32.137 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395811&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:03:34.470 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768395814 status=200 resp_size=5679
|
||
2026-01-14 21:03:34.599 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395814&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:03:34.599 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:03:39.189 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:03:39.189 | INFO | __main__:crawl_multiple_pages:1025 - 检测到API返回totalCount: 508 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-14 21:03:39.189 | INFO | __main__:crawl_multiple_pages:1029 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-14 21:03:41.660 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 2.47 秒后继续...
|
||
2026-01-14 21:03:41.660 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-14 21:03:41.661 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:03:41.678 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=2, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:03:42.037 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:03:43.126 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:03:45.217 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:03:45.218 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:03:45.617 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395821 status=200 resp_size=106226
|
||
2026-01-14 21:03:45.618 | INFO | __main__:get_recommend_jobs:745 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:03:45.757 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170273603?api_key=51job×tamp=1768395825 status=200 resp_size=5711
|
||
2026-01-14 21:03:45.881 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395825&companyId=10152956&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2648
|
||
2026-01-14 21:03:56.980 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768395833 status=200 resp_size=5739
|
||
2026-01-14 21:03:57.381 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395836&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-14 21:04:02.835 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768395841 status=200 resp_size=5585
|
||
2026-01-14 21:04:03.515 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395842&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:04:07.474 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768395845 status=200 resp_size=6332
|
||
2026-01-14 21:04:07.752 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395847&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-14 21:04:13.514 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768395853 status=200 resp_size=4913
|
||
2026-01-14 21:04:13.638 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395853&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-14 21:04:17.807 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768395857 status=200 resp_size=5502
|
||
2026-01-14 21:04:17.948 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395857&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-14 21:04:33.765 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768395867 status=200 resp_size=5198
|
||
2026-01-14 21:04:35.155 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395873&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-14 21:04:40.484 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768395877 status=200 resp_size=6134
|
||
2026-01-14 21:04:40.826 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395880&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-14 21:04:49.429 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768395888 status=200 resp_size=6032
|
||
2026-01-14 21:04:49.593 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395889&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:04:56.090 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768395895 status=200 resp_size=5609
|
||
2026-01-14 21:04:56.282 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395896&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-14 21:05:00.945 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768395900 status=200 resp_size=5128
|
||
2026-01-14 21:05:01.092 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395900&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-14 21:05:09.127 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768395908 status=200 resp_size=5970
|
||
2026-01-14 21:05:09.327 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395909&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-14 21:05:16.148 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170264772?api_key=51job×tamp=1768395915 status=200 resp_size=6220
|
||
2026-01-14 21:05:16.319 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395916&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 21:05:19.905 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768395919 status=200 resp_size=5623
|
||
2026-01-14 21:05:20.083 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395919&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:05:21.319 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768395921 status=200 resp_size=5372
|
||
2026-01-14 21:05:21.481 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395921&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:05:33.142 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768395928 status=200 resp_size=5484
|
||
2026-01-14 21:05:33.520 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395933&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-14 21:05:41.281 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768395940 status=200 resp_size=8592
|
||
2026-01-14 21:05:41.491 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395941&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 21:05:48.536 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768395947 status=200 resp_size=5612
|
||
2026-01-14 21:05:48.714 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395948&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 21:05:52.203 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768395952 status=200 resp_size=5704
|
||
2026-01-14 21:05:52.379 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395952&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:05:54.882 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768395954 status=200 resp_size=5519
|
||
2026-01-14 21:05:55.053 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395954&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:05:55.053 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:05:59.760 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:05:59.760 | INFO | __main__:crawl_multiple_pages:1029 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-14 21:06:09.456 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 9.69 秒后继续...
|
||
2026-01-14 21:06:09.457 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-14 21:06:09.458 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:06:09.481 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=3, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:06:10.252 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:06:11.415 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:06:13.572 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:06:13.572 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:06:14.089 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768395969 status=200 resp_size=107504
|
||
2026-01-14 21:06:14.090 | INFO | __main__:get_recommend_jobs:745 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:06:15.334 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768395974 status=200 resp_size=5708
|
||
2026-01-14 21:06:15.656 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395975&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:06:22.131 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768395981 status=200 resp_size=6076
|
||
2026-01-14 21:06:22.390 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395982&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 21:06:30.320 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768395987 status=200 resp_size=5668
|
||
2026-01-14 21:06:30.720 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395990&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-14 21:06:33.447 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768395993 status=200 resp_size=5531
|
||
2026-01-14 21:06:33.717 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768395993&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-14 21:06:43.181 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768396001 status=200 resp_size=5409
|
||
2026-01-14 21:06:43.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396003&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-14 21:06:53.339 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768396012 status=200 resp_size=6312
|
||
2026-01-14 21:06:53.593 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396013&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-14 21:07:03.716 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768396022 status=200 resp_size=5127
|
||
2026-01-14 21:07:03.948 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396023&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-14 21:07:10.419 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768396029 status=200 resp_size=5202
|
||
2026-01-14 21:07:10.622 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396030&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-14 21:07:19.223 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768396038 status=200 resp_size=6446
|
||
2026-01-14 21:07:19.430 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396039&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-14 21:07:22.996 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768396042 status=200 resp_size=6003
|
||
2026-01-14 21:07:23.193 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396042&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-14 21:07:27.205 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768396047 status=200 resp_size=5339
|
||
2026-01-14 21:07:27.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396047&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:07:30.433 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768396050 status=200 resp_size=5734
|
||
2026-01-14 21:07:30.634 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396050&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 21:07:37.301 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768396056 status=200 resp_size=6974
|
||
2026-01-14 21:07:37.460 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396057&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:07:41.871 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768396061 status=200 resp_size=5727
|
||
2026-01-14 21:07:42.016 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396061&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:07:51.046 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768396070 status=200 resp_size=5244
|
||
2026-01-14 21:07:51.177 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396071&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 21:07:53.678 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768396073 status=200 resp_size=5733
|
||
2026-01-14 21:07:53.810 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396073&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:08:00.622 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768396080 status=200 resp_size=5898
|
||
2026-01-14 21:08:00.791 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396080&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-14 21:08:11.280 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768396090 status=200 resp_size=6025
|
||
2026-01-14 21:08:11.465 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396091&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-14 21:08:19.209 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768396098 status=200 resp_size=5243
|
||
2026-01-14 21:08:19.438 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396099&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:08:20.770 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768396100 status=200 resp_size=6147
|
||
2026-01-14 21:08:20.990 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396100&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-14 21:08:20.990 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:08:21.121 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:08:21.122 | INFO | __main__:crawl_multiple_pages:1029 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-14 21:08:28.718 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 7.59 秒后继续...
|
||
2026-01-14 21:08:28.718 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-14 21:08:28.719 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:08:28.735 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=4, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:08:29.532 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:08:30.776 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:08:33.084 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:08:33.085 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:08:33.682 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396108 status=200 resp_size=117488
|
||
2026-01-14 21:08:33.682 | INFO | __main__:get_recommend_jobs:745 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:08:33.901 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170261099?api_key=51job×tamp=1768396113 status=200 resp_size=6148
|
||
2026-01-14 21:08:34.166 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396113&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 21:08:37.267 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768396117 status=200 resp_size=6657
|
||
2026-01-14 21:08:37.486 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396117&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:08:48.045 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768396127 status=200 resp_size=5829
|
||
2026-01-14 21:08:48.283 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396128&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:08:50.199 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768396129 status=200 resp_size=6454
|
||
2026-01-14 21:08:50.452 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396130&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:08:52.784 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768396132 status=200 resp_size=5995
|
||
2026-01-14 21:08:53.036 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396132&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:08:57.217 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768396136 status=200 resp_size=6489
|
||
2026-01-14 21:08:57.449 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396137&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:09:01.681 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768396141 status=200 resp_size=5789
|
||
2026-01-14 21:09:01.927 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396141&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:09:11.317 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768396150 status=200 resp_size=5826
|
||
2026-01-14 21:09:11.524 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396151&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:09:15.845 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170272059?api_key=51job×tamp=1768396154 status=200 resp_size=5534
|
||
2026-01-14 21:09:16.081 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396155&companyId=7148533&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6045
|
||
2026-01-14 21:09:23.615 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768396163 status=200 resp_size=5967
|
||
2026-01-14 21:09:23.788 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396163&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:09:25.382 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768396165 status=200 resp_size=6398
|
||
2026-01-14 21:09:25.560 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396165&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:09:38.351 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768396173 status=200 resp_size=6045
|
||
2026-01-14 21:09:38.730 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396178&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:09:47.454 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768396186 status=200 resp_size=5994
|
||
2026-01-14 21:09:47.694 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396187&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:09:48.947 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768396188 status=200 resp_size=6523
|
||
2026-01-14 21:09:49.187 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396188&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:09:59.614 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768396198 status=200 resp_size=5936
|
||
2026-01-14 21:09:59.794 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396199&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:10:01.875 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768396201 status=200 resp_size=4058
|
||
2026-01-14 21:10:02.081 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396201&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-14 21:10:08.583 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768396207 status=200 resp_size=6206
|
||
2026-01-14 21:10:08.786 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396208&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-14 21:10:16.180 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768396215 status=200 resp_size=6191
|
||
2026-01-14 21:10:17.511 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396216&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 21:10:26.912 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768396225 status=200 resp_size=5247
|
||
2026-01-14 21:10:27.089 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396226&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:10:31.198 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768396231 status=200 resp_size=6148
|
||
2026-01-14 21:10:31.364 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396231&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:10:31.364 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:10:31.443 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:10:31.443 | INFO | __main__:crawl_multiple_pages:1029 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-14 21:10:35.246 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 3.80 秒后继续...
|
||
2026-01-14 21:10:35.246 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-14 21:10:35.246 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:10:35.261 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=5, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:10:35.955 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:10:37.164 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:10:39.368 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:10:39.369 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:10:39.893 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396235 status=200 resp_size=139873
|
||
2026-01-14 21:10:39.893 | WARNING | __main__:get_recommend_jobs:743 - 第 5 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:10:39.893 | INFO | __main__:get_recommend_jobs:745 - 第 5 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:10:40.089 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768396239 status=200 resp_size=6069
|
||
2026-01-14 21:10:40.300 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396240&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 21:10:49.852 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768396249 status=200 resp_size=5649
|
||
2026-01-14 21:10:50.011 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396249&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:10:54.616 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768396254 status=200 resp_size=5478
|
||
2026-01-14 21:10:54.777 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396254&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:11:03.987 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768396263 status=200 resp_size=5524
|
||
2026-01-14 21:11:04.199 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396263&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-14 21:11:07.678 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768396267 status=200 resp_size=5884
|
||
2026-01-14 21:11:07.913 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396267&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:11:16.968 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768396275 status=200 resp_size=7569
|
||
2026-01-14 21:11:17.126 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396276&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-14 21:11:26.721 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768396284 status=200 resp_size=5851
|
||
2026-01-14 21:11:27.336 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396286&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:11:29.094 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768396288 status=200 resp_size=7768
|
||
2026-01-14 21:11:30.445 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396289&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 21:11:34.820 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768396294 status=200 resp_size=5695
|
||
2026-01-14 21:11:36.577 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396294&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-14 21:11:44.896 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768396301 status=200 resp_size=6336
|
||
2026-01-14 21:11:45.200 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396304&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-14 21:11:56.116 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768396312 status=200 resp_size=6523
|
||
2026-01-14 21:11:56.369 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396316&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:12:08.183 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768396326 status=200 resp_size=7321
|
||
2026-01-14 21:12:08.404 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396328&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-14 21:12:12.703 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768396332 status=200 resp_size=7521
|
||
2026-01-14 21:12:12.928 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396332&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-14 21:12:20.348 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768396339 status=200 resp_size=6449
|
||
2026-01-14 21:12:20.547 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396340&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-14 21:12:22.813 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768396342 status=200 resp_size=8382
|
||
2026-01-14 21:12:23.017 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396342&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-14 21:12:30.960 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768396350 status=200 resp_size=7151
|
||
2026-01-14 21:12:31.120 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396350&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 21:12:40.515 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768396359 status=200 resp_size=6428
|
||
2026-01-14 21:12:40.706 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396360&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-14 21:12:46.488 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768396366 status=200 resp_size=6133
|
||
2026-01-14 21:12:46.656 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396366&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:12:56.754 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768396375 status=200 resp_size=5894
|
||
2026-01-14 21:12:57.133 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396376&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:12:57.133 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 5 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:12:57.262 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:12:57.263 | INFO | __main__:crawl_multiple_pages:1029 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-14 21:13:00.108 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 2.84 秒后继续...
|
||
2026-01-14 21:13:00.108 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-14 21:13:00.109 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:13:00.129 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=6, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:13:01.512 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:13:02.795 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:13:05.257 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:13:05.257 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:13:07.041 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396380 status=200 resp_size=131267
|
||
2026-01-14 21:13:07.041 | WARNING | __main__:get_recommend_jobs:743 - 第 6 页发现 4 个重复职位（已跳过）
|
||
2026-01-14 21:13:07.041 | INFO | __main__:get_recommend_jobs:745 - 第 6 页成功获取 20 个职位（去重后: 16） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:13:07.348 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768396387 status=200 resp_size=5652
|
||
2026-01-14 21:13:09.068 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396387&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-14 21:13:14.984 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768396394 status=200 resp_size=6033
|
||
2026-01-14 21:13:15.278 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396394&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-14 21:13:19.885 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768396399 status=200 resp_size=6874
|
||
2026-01-14 21:13:21.312 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396399&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-14 21:13:24.117 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768396403 status=200 resp_size=7105
|
||
2026-01-14 21:13:24.438 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396404&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-14 21:13:31.842 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768396411 status=200 resp_size=6731
|
||
2026-01-14 21:13:31.999 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396411&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-14 21:13:33.791 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768396413 status=200 resp_size=5433
|
||
2026-01-14 21:13:33.972 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396413&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:13:38.938 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768396418 status=200 resp_size=6583
|
||
2026-01-14 21:13:39.090 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396418&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 21:13:42.161 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768396422 status=200 resp_size=6733
|
||
2026-01-14 21:13:42.318 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396422&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-14 21:13:52.211 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768396431 status=200 resp_size=5863
|
||
2026-01-14 21:13:52.401 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396432&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-14 21:14:02.887 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768396442 status=200 resp_size=5244
|
||
2026-01-14 21:14:03.078 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396442&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12319
|
||
2026-01-14 21:14:05.695 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768396445 status=200 resp_size=5967
|
||
2026-01-14 21:14:05.876 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396445&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 21:14:08.314 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768396448 status=200 resp_size=6388
|
||
2026-01-14 21:14:08.478 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396448&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-14 21:14:16.913 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768396456 status=200 resp_size=6560
|
||
2026-01-14 21:14:17.160 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396456&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:14:23.154 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768396462 status=200 resp_size=6429
|
||
2026-01-14 21:14:23.393 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396463&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:14:27.245 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768396466 status=200 resp_size=5809
|
||
2026-01-14 21:14:27.494 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396467&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 21:14:35.388 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768396474 status=200 resp_size=7206
|
||
2026-01-14 21:14:35.553 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396475&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-14 21:14:35.553 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 6 页数据，包含详细信息的数据条数: 16
|
||
2026-01-14 21:14:39.683 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 16, 响应大小: 113 字节
|
||
2026-01-14 21:14:39.685 | INFO | __main__:crawl_multiple_pages:1029 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-14 21:14:41.400 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 1.71 秒后继续...
|
||
2026-01-14 21:14:41.400 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-14 21:14:41.401 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:14:41.423 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=7, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:14:45.957 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:14:47.126 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:14:49.314 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:14:49.314 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:14:49.895 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396481 status=200 resp_size=159521
|
||
2026-01-14 21:14:49.896 | WARNING | __main__:get_recommend_jobs:743 - 第 7 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:14:49.897 | INFO | __main__:get_recommend_jobs:745 - 第 7 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:14:50.118 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768396489 status=200 resp_size=6407
|
||
2026-01-14 21:14:50.311 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396490&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:14:55.460 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768396495 status=200 resp_size=7291
|
||
2026-01-14 21:14:55.650 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396495&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-14 21:15:03.342 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768396502 status=200 resp_size=7292
|
||
2026-01-14 21:15:03.613 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396503&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 21:15:13.245 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768396512 status=200 resp_size=6361
|
||
2026-01-14 21:15:16.559 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396513&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-14 21:15:24.335 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768396523 status=200 resp_size=5513
|
||
2026-01-14 21:15:24.685 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396524&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:15:30.856 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768396529 status=200 resp_size=5635
|
||
2026-01-14 21:15:30.984 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396530&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-14 21:15:35.435 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768396535 status=200 resp_size=5682
|
||
2026-01-14 21:15:35.879 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396535&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-14 21:15:44.370 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768396541 status=200 resp_size=7975
|
||
2026-01-14 21:15:44.648 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396544&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-14 21:15:53.549 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768396552 status=200 resp_size=6697
|
||
2026-01-14 21:15:53.787 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396553&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:15:58.094 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768396557 status=200 resp_size=7141
|
||
2026-01-14 21:15:58.330 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396558&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-14 21:16:06.965 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768396565 status=200 resp_size=5621
|
||
2026-01-14 21:16:07.206 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396566&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-14 21:16:10.055 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768396569 status=200 resp_size=7985
|
||
2026-01-14 21:16:10.262 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396570&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-14 21:16:20.934 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768396579 status=200 resp_size=6292
|
||
2026-01-14 21:16:21.282 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396580&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:16:26.178 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768396584 status=200 resp_size=6736
|
||
2026-01-14 21:16:26.377 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396586&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-14 21:16:37.158 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768396596 status=200 resp_size=6198
|
||
2026-01-14 21:16:37.445 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396597&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-14 21:16:43.984 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768396603 status=200 resp_size=5793
|
||
2026-01-14 21:16:44.246 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396603&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-14 21:16:50.077 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768396609 status=200 resp_size=6396
|
||
2026-01-14 21:16:50.267 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396610&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:16:55.005 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768396614 status=200 resp_size=6190
|
||
2026-01-14 21:16:55.200 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396615&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-14 21:16:57.019 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768396616 status=200 resp_size=6702
|
||
2026-01-14 21:16:57.211 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396617&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-14 21:16:57.211 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 7 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:16:57.323 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:16:57.323 | INFO | __main__:crawl_multiple_pages:1029 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-14 21:17:06.781 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 9.45 秒后继续...
|
||
2026-01-14 21:17:06.781 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-14 21:17:06.781 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:17:06.809 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=8, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:17:07.710 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:17:08.941 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:17:11.165 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:17:11.166 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:17:11.738 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396626 status=200 resp_size=139455
|
||
2026-01-14 21:17:11.738 | WARNING | __main__:get_recommend_jobs:743 - 第 8 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:17:11.739 | INFO | __main__:get_recommend_jobs:745 - 第 8 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:17:11.983 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768396631 status=200 resp_size=13124
|
||
2026-01-14 21:17:12.247 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396631&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-14 21:17:20.491 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768396639 status=200 resp_size=5134
|
||
2026-01-14 21:17:20.695 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396640&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 21:17:33.470 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768396647 status=200 resp_size=7116
|
||
2026-01-14 21:17:33.810 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396653&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:17:40.624 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768396659 status=200 resp_size=6380
|
||
2026-01-14 21:17:42.028 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396660&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-14 21:17:46.477 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768396665 status=200 resp_size=6537
|
||
2026-01-14 21:17:48.135 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396666&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 21:17:54.232 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768396673 status=200 resp_size=7415
|
||
2026-01-14 21:17:54.467 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396674&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-14 21:17:58.910 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job×tamp=1768396678 status=200 resp_size=6226
|
||
2026-01-14 21:17:59.060 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396678&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:18:24.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768396685 status=200 resp_size=5170
|
||
2026-01-14 21:18:24.687 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396704&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-14 21:18:30.680 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768396708 status=200 resp_size=5949
|
||
2026-01-14 21:18:30.898 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396710&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-14 21:18:36.716 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768396716 status=200 resp_size=6035
|
||
2026-01-14 21:18:36.873 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396716&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-14 21:19:05.583 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768396723 status=200 resp_size=8826
|
||
2026-01-14 21:19:06.590 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396745&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:19:26.779 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768396751 status=200 resp_size=5120
|
||
2026-01-14 21:19:29.346 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396766&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-14 21:19:36.446 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768396773 status=200 resp_size=5458
|
||
2026-01-14 21:19:37.333 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396776&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-14 21:19:46.196 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768396785 status=200 resp_size=4984
|
||
2026-01-14 21:19:46.457 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396786&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-14 21:19:56.521 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768396794 status=200 resp_size=5928
|
||
2026-01-14 21:19:56.867 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396796&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:20:01.463 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768396801 status=200 resp_size=5131
|
||
2026-01-14 21:20:01.739 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396801&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-14 21:20:06.816 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768396806 status=200 resp_size=5734
|
||
2026-01-14 21:20:10.230 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396806&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-14 21:20:24.748 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768396818 status=200 resp_size=7000
|
||
2026-01-14 21:20:25.886 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396824&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-14 21:20:31.231 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768396829 status=200 resp_size=6453
|
||
2026-01-14 21:20:31.577 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396831&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:20:31.577 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 8 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:20:36.445 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:20:36.446 | INFO | __main__:crawl_multiple_pages:1029 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-14 21:20:40.416 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 3.96 秒后继续...
|
||
2026-01-14 21:20:40.420 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-14 21:20:40.421 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:20:40.439 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=9, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:20:44.362 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:20:45.947 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:20:48.805 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:20:48.805 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:20:50.378 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396840 status=200 resp_size=143434
|
||
2026-01-14 21:20:50.378 | WARNING | __main__:get_recommend_jobs:743 - 第 9 页发现 2 个重复职位（已跳过）
|
||
2026-01-14 21:20:50.379 | INFO | __main__:get_recommend_jobs:745 - 第 9 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:20:51.357 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768396850 status=200 resp_size=8734
|
||
2026-01-14 21:20:52.347 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396851&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-14 21:20:56.806 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768396855 status=200 resp_size=5719
|
||
2026-01-14 21:20:57.726 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396856&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-14 21:21:04.361 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170273401?api_key=51job×tamp=1768396863 status=200 resp_size=5878
|
||
2026-01-14 21:21:04.576 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396864&companyId=10153701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2744
|
||
2026-01-14 21:21:11.270 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170262084?api_key=51job×tamp=1768396869 status=200 resp_size=5538
|
||
2026-01-14 21:21:12.146 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396871&companyId=10152578&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2979
|
||
2026-01-14 21:21:19.314 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768396877 status=200 resp_size=5560
|
||
2026-01-14 21:21:19.605 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396879&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-14 21:21:22.492 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768396882 status=200 resp_size=6533
|
||
2026-01-14 21:21:22.723 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396882&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-14 21:21:33.324 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768396892 status=200 resp_size=5017
|
||
2026-01-14 21:21:33.568 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396893&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:21:40.660 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768396899 status=200 resp_size=5476
|
||
2026-01-14 21:21:40.920 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396900&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-14 21:21:45.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768396905 status=200 resp_size=7255
|
||
2026-01-14 21:21:45.687 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396905&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-14 21:21:52.075 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768396911 status=200 resp_size=5364
|
||
2026-01-14 21:21:52.273 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396912&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-14 21:21:54.228 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768396914 status=200 resp_size=6509
|
||
2026-01-14 21:21:54.720 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396914&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:22:05.080 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768396923 status=200 resp_size=5427
|
||
2026-01-14 21:22:05.660 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396925&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-14 21:22:08.722 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768396928 status=200 resp_size=7625
|
||
2026-01-14 21:22:09.035 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396928&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:22:15.006 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768396934 status=200 resp_size=7217
|
||
2026-01-14 21:22:16.293 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396935&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-14 21:22:23.316 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768396942 status=200 resp_size=5694
|
||
2026-01-14 21:22:23.505 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396943&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:22:31.443 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job×tamp=1768396951 status=200 resp_size=7379
|
||
2026-01-14 21:22:31.634 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396951&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-14 21:22:41.325 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job×tamp=1768396960 status=200 resp_size=4531
|
||
2026-01-14 21:22:41.547 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396961&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
|
||
2026-01-14 21:22:50.087 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768396969 status=200 resp_size=8465
|
||
2026-01-14 21:22:50.347 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396970&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:22:50.347 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 9 页数据，包含详细信息的数据条数: 18
|
||
2026-01-14 21:22:54.865 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
|
||
2026-01-14 21:22:54.866 | INFO | __main__:crawl_multiple_pages:1029 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-14 21:22:56.878 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 2.01 秒后继续...
|
||
2026-01-14 21:22:56.878 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-14 21:22:56.879 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:22:56.907 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=10, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:22:57.711 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:22:58.878 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:23:01.074 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:23:01.074 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:23:01.591 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768396976 status=200 resp_size=155217
|
||
2026-01-14 21:23:01.592 | INFO | __main__:get_recommend_jobs:745 - 第 10 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:23:01.810 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768396981 status=200 resp_size=6688
|
||
2026-01-14 21:23:02.035 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396981&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-14 21:23:12.238 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768396990 status=200 resp_size=5495
|
||
2026-01-14 21:23:12.889 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396992&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-14 21:23:18.819 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768396998 status=200 resp_size=6484
|
||
2026-01-14 21:23:19.029 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768396998&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-14 21:23:29.825 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768397008 status=200 resp_size=6766
|
||
2026-01-14 21:23:30.082 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397009&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:23:38.393 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768397017 status=200 resp_size=5925
|
||
2026-01-14 21:23:38.754 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397018&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-14 21:23:50.010 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768397028 status=200 resp_size=7762
|
||
2026-01-14 21:23:50.255 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397030&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-14 21:23:51.978 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768397031 status=200 resp_size=7982
|
||
2026-01-14 21:23:52.225 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397031&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7841
|
||
2026-01-14 21:23:56.922 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768397036 status=200 resp_size=5443
|
||
2026-01-14 21:23:57.162 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397036&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:24:07.024 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768397046 status=200 resp_size=8325
|
||
2026-01-14 21:24:07.220 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397047&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-14 21:24:08.460 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768397048 status=200 resp_size=5424
|
||
2026-01-14 21:24:08.697 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397048&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-14 21:24:18.267 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768397055 status=200 resp_size=8995
|
||
2026-01-14 21:24:19.635 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397058&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-14 21:24:27.243 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768397066 status=200 resp_size=6174
|
||
2026-01-14 21:24:27.431 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397067&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:24:30.296 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768397070 status=200 resp_size=6706
|
||
2026-01-14 21:24:30.441 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397070&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-14 21:24:35.361 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768397075 status=200 resp_size=8301
|
||
2026-01-14 21:24:35.514 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397075&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-14 21:24:39.744 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768397079 status=200 resp_size=5408
|
||
2026-01-14 21:24:39.896 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397079&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-14 21:24:48.326 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768397087 status=200 resp_size=6076
|
||
2026-01-14 21:24:48.475 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397088&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:24:51.507 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768397091 status=200 resp_size=7193
|
||
2026-01-14 21:24:51.643 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397091&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-14 21:25:02.115 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768397101 status=200 resp_size=6076
|
||
2026-01-14 21:25:02.359 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397102&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-14 21:25:10.306 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768397108 status=200 resp_size=4916
|
||
2026-01-14 21:25:10.692 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397110&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-14 21:25:16.730 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768397115 status=200 resp_size=6083
|
||
2026-01-14 21:25:17.073 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397116&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-14 21:25:17.073 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 10 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:25:22.228 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:25:22.229 | INFO | __main__:crawl_multiple_pages:1029 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-14 21:25:25.676 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 3.44 秒后继续...
|
||
2026-01-14 21:25:25.676 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-14 21:25:25.677 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:25:25.695 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=11, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:25:26.515 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:25:29.006 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:25:31.169 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:25:31.169 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:25:31.967 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397125 status=200 resp_size=141677
|
||
2026-01-14 21:25:31.968 | INFO | __main__:get_recommend_jobs:745 - 第 11 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:25:32.165 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768397131 status=200 resp_size=5880
|
||
2026-01-14 21:25:32.399 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397132&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:25:36.757 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768397136 status=200 resp_size=6244
|
||
2026-01-14 21:25:37.844 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397136&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-14 21:25:45.761 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768397144 status=200 resp_size=5691
|
||
2026-01-14 21:25:45.970 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397145&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-14 21:25:49.226 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768397149 status=200 resp_size=5597
|
||
2026-01-14 21:25:49.434 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397149&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-14 21:26:10.910 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768397158 status=200 resp_size=5802
|
||
2026-01-14 21:26:12.303 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397170&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:26:16.053 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170265703?api_key=51job×tamp=1768397174 status=200 resp_size=5023
|
||
2026-01-14 21:26:17.360 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397176&companyId=3622529&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3790
|
||
2026-01-14 21:26:20.988 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768397179 status=200 resp_size=5766
|
||
2026-01-14 21:26:22.154 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397180&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-14 21:26:30.958 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768397190 status=200 resp_size=8622
|
||
2026-01-14 21:26:31.212 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397190&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-14 21:26:37.155 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job×tamp=1768397196 status=200 resp_size=5312
|
||
2026-01-14 21:26:37.395 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397197&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-14 21:26:42.098 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768397201 status=200 resp_size=8723
|
||
2026-01-14 21:26:42.349 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397202&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-14 21:26:44.506 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768397204 status=200 resp_size=6017
|
||
2026-01-14 21:26:44.760 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397204&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-14 21:26:51.669 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768397210 status=200 resp_size=7941
|
||
2026-01-14 21:26:51.948 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397211&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-14 21:26:55.408 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768397213 status=200 resp_size=7693
|
||
2026-01-14 21:26:55.856 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397215&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-14 21:27:03.776 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768397223 status=200 resp_size=5281
|
||
2026-01-14 21:27:04.027 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397223&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-14 21:27:06.341 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768397226 status=200 resp_size=6680
|
||
2026-01-14 21:27:07.611 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397226&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 21:27:11.293 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768397231 status=200 resp_size=5408
|
||
2026-01-14 21:27:11.485 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397231&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-14 21:27:21.927 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768397241 status=200 resp_size=6647
|
||
2026-01-14 21:27:22.140 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397241&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-14 21:27:23.900 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768397243 status=200 resp_size=5289
|
||
2026-01-14 21:27:24.112 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397243&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-14 21:27:32.448 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768397251 status=200 resp_size=6290
|
||
2026-01-14 21:27:32.676 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397252&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:27:39.825 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768397258 status=200 resp_size=5924
|
||
2026-01-14 21:27:40.091 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397259&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-14 21:27:40.091 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 11 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:27:40.237 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:27:40.237 | INFO | __main__:crawl_multiple_pages:1029 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-14 21:27:46.631 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 6.39 秒后继续...
|
||
2026-01-14 21:27:46.632 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-14 21:27:46.632 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:27:46.652 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=12, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:27:48.501 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:27:49.659 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:27:51.846 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:27:51.847 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:27:52.424 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397266 status=200 resp_size=123583
|
||
2026-01-14 21:27:52.424 | WARNING | __main__:get_recommend_jobs:743 - 第 12 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:27:52.424 | INFO | __main__:get_recommend_jobs:745 - 第 12 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:27:52.656 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768397272 status=200 resp_size=6021
|
||
2026-01-14 21:27:52.852 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397272&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-14 21:27:59.795 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158032256?api_key=51job×tamp=1768397278 status=200 resp_size=6753
|
||
2026-01-14 21:28:00.024 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397279&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-14 21:28:10.435 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768397289 status=200 resp_size=5399
|
||
2026-01-14 21:28:10.821 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397290&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-14 21:28:12.929 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768397292 status=200 resp_size=5080
|
||
2026-01-14 21:28:13.162 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397292&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:28:17.010 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768397296 status=200 resp_size=5728
|
||
2026-01-14 21:28:18.481 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397297&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-14 21:28:24.399 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job×tamp=1768397303 status=200 resp_size=6876
|
||
2026-01-14 21:28:26.433 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397304&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
|
||
2026-01-14 21:28:32.479 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768397310 status=200 resp_size=6059
|
||
2026-01-14 21:28:32.922 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397312&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-14 21:28:40.209 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768397319 status=200 resp_size=5280
|
||
2026-01-14 21:28:40.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397320&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-14 21:28:44.660 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158021791?api_key=51job×tamp=1768397324 status=200 resp_size=4974
|
||
2026-01-14 21:28:44.938 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397324&companyId=2655982&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5342
|
||
2026-01-14 21:28:47.748 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job×tamp=1768397327 status=200 resp_size=9513
|
||
2026-01-14 21:28:47.986 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397327&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-14 21:28:51.197 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job×tamp=1768397331 status=200 resp_size=6597
|
||
2026-01-14 21:28:51.423 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397331&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-14 21:28:59.212 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168628778?api_key=51job×tamp=1768397338 status=200 resp_size=8091
|
||
2026-01-14 21:28:59.523 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397339&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-14 21:29:06.066 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161745455?api_key=51job×tamp=1768397345 status=200 resp_size=6340
|
||
2026-01-14 21:29:06.188 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397346&companyId=1314438&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4164
|
||
2026-01-14 21:29:08.215 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job×tamp=1768397348 status=200 resp_size=6079
|
||
2026-01-14 21:29:08.340 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397348&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:29:11.409 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job×tamp=1768397351 status=200 resp_size=5354
|
||
2026-01-14 21:29:11.538 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397351&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-14 21:29:14.840 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job×tamp=1768397354 status=200 resp_size=5014
|
||
2026-01-14 21:29:14.981 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397354&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
|
||
2026-01-14 21:29:16.191 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job×tamp=1768397356 status=200 resp_size=7224
|
||
2026-01-14 21:29:16.335 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397356&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
|
||
2026-01-14 21:29:19.319 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job×tamp=1768397359 status=200 resp_size=5584
|
||
2026-01-14 21:29:19.463 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397359&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-14 21:29:20.967 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job×tamp=1768397360 status=200 resp_size=5070
|
||
2026-01-14 21:29:21.091 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397360&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
|
||
2026-01-14 21:29:21.091 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 12 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:29:21.199 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:29:21.199 | INFO | __main__:crawl_multiple_pages:1029 - 第 12 页获取到 20 个职位 | 累计: 240 个
|
||
2026-01-14 21:29:24.746 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 3.54 秒后继续...
|
||
2026-01-14 21:29:24.746 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 13/26 页...
|
||
2026-01-14 21:29:24.746 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:29:24.758 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=13, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:29:25.574 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:29:26.786 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:29:29.000 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:29:29.001 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:29:29.546 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397364 status=200 resp_size=147027
|
||
2026-01-14 21:29:29.546 | INFO | __main__:get_recommend_jobs:745 - 第 13 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:29:29.793 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job×tamp=1768397369 status=200 resp_size=4989
|
||
2026-01-14 21:29:30.034 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397369&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:29:40.553 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job×tamp=1768397376 status=200 resp_size=6768
|
||
2026-01-14 21:29:41.978 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397380&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:29:45.345 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job×tamp=1768397384 status=200 resp_size=5889
|
||
2026-01-14 21:29:45.697 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397385&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
|
||
2026-01-14 21:29:52.187 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188854?api_key=51job×tamp=1768397391 status=200 resp_size=4825
|
||
2026-01-14 21:29:52.409 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397392&companyId=7206810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4861
|
||
2026-01-14 21:30:00.829 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job×tamp=1768397399 status=200 resp_size=5732
|
||
2026-01-14 21:30:01.024 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397400&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
|
||
2026-01-14 21:30:02.382 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job×tamp=1768397402 status=200 resp_size=7569
|
||
2026-01-14 21:30:02.609 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397402&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
|
||
2026-01-14 21:30:09.144 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job×tamp=1768397408 status=200 resp_size=8231
|
||
2026-01-14 21:30:09.399 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397409&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
|
||
2026-01-14 21:30:17.326 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169702519?api_key=51job×tamp=1768397416 status=200 resp_size=5476
|
||
2026-01-14 21:30:17.576 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397417&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-14 21:30:28.135 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job×tamp=1768397427 status=200 resp_size=6980
|
||
2026-01-14 21:30:28.378 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397428&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
|
||
2026-01-14 21:30:39.425 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job×tamp=1768397435 status=200 resp_size=5313
|
||
2026-01-14 21:30:40.252 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397439&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-14 21:30:46.235 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job×tamp=1768397445 status=200 resp_size=5760
|
||
2026-01-14 21:30:46.471 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397446&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-14 21:30:51.288 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job×tamp=1768397451 status=200 resp_size=5514
|
||
2026-01-14 21:30:51.534 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397451&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
|
||
2026-01-14 21:30:56.295 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job×tamp=1768397456 status=200 resp_size=9126
|
||
2026-01-14 21:30:56.542 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397456&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
|
||
2026-01-14 21:30:58.608 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job×tamp=1768397458 status=200 resp_size=5700
|
||
2026-01-14 21:30:58.853 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397458&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7954
|
||
2026-01-14 21:31:09.527 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job×tamp=1768397468 status=200 resp_size=6398
|
||
2026-01-14 21:31:09.747 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397469&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-14 21:31:17.522 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169246419?api_key=51job×tamp=1768397474 status=200 resp_size=6621
|
||
2026-01-14 21:31:17.924 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397477&companyId=2243741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18085
|
||
2026-01-14 21:31:24.724 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151782667?api_key=51job×tamp=1768397483 status=200 resp_size=7987
|
||
2026-01-14 21:31:24.975 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397484&companyId=3693563&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6458
|
||
2026-01-14 21:31:34.812 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226728?api_key=51job×tamp=1768397493 status=200 resp_size=6002
|
||
2026-01-14 21:31:35.137 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397494&companyId=9901093&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-14 21:31:42.705 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226209?api_key=51job×tamp=1768397501 status=200 resp_size=5600
|
||
2026-01-14 21:31:42.931 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397502&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-14 21:31:48.857 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job×tamp=1768397508 status=200 resp_size=6574
|
||
2026-01-14 21:31:49.007 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397508&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
|
||
2026-01-14 21:31:49.008 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 13 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:31:54.082 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:31:54.083 | INFO | __main__:crawl_multiple_pages:1029 - 第 13 页获取到 20 个职位 | 累计: 260 个
|
||
2026-01-14 21:31:58.808 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 4.72 秒后继续...
|
||
2026-01-14 21:31:58.808 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 14/26 页...
|
||
2026-01-14 21:31:58.808 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:31:58.821 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=14, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:31:59.851 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:32:01.192 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:32:03.594 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:32:03.594 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:32:04.300 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397518 status=200 resp_size=156230
|
||
2026-01-14 21:32:04.300 | INFO | __main__:get_recommend_jobs:745 - 第 14 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:32:04.625 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170227996?api_key=51job×tamp=1768397524 status=200 resp_size=5942
|
||
2026-01-14 21:32:05.081 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397524&companyId=7511049&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4272
|
||
2026-01-14 21:32:09.124 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job×tamp=1768397528 status=200 resp_size=6602
|
||
2026-01-14 21:32:09.257 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397529&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
|
||
2026-01-14 21:32:16.388 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160656038?api_key=51job×tamp=1768397535 status=200 resp_size=6027
|
||
2026-01-14 21:32:16.529 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397536&companyId=6038176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4810
|
||
2026-01-14 21:32:27.619 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170267609?api_key=51job×tamp=1768397545 status=200 resp_size=4727
|
||
2026-01-14 21:32:27.812 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397547&companyId=9996510&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8184
|
||
2026-01-14 21:32:37.102 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job×tamp=1768397555 status=200 resp_size=6285
|
||
2026-01-14 21:32:37.379 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397557&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
|
||
2026-01-14 21:32:46.520 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167561159?api_key=51job×tamp=1768397565 status=200 resp_size=5267
|
||
2026-01-14 21:32:46.838 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397566&companyId=1236787&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9516
|
||
2026-01-14 21:32:57.890 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job×tamp=1768397573 status=200 resp_size=6130
|
||
2026-01-14 21:33:01.253 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397577&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6942
|
||
2026-01-14 21:33:10.924 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job×tamp=1768397589 status=200 resp_size=8800
|
||
2026-01-14 21:33:11.215 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397590&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-14 21:33:22.202 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job×tamp=1768397600 status=200 resp_size=6717
|
||
2026-01-14 21:33:22.694 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397602&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14351
|
||
2026-01-14 21:33:26.046 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job×tamp=1768397605 status=200 resp_size=8688
|
||
2026-01-14 21:33:26.193 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397606&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
|
||
2026-01-14 21:33:29.751 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217460?api_key=51job×tamp=1768397609 status=200 resp_size=6462
|
||
2026-01-14 21:33:29.906 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397609&companyId=202650&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11287
|
||
2026-01-14 21:33:37.446 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768397616 status=200 resp_size=7928
|
||
2026-01-14 21:33:37.680 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397617&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-14 21:33:39.261 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job×tamp=1768397619 status=200 resp_size=5896
|
||
2026-01-14 21:33:39.495 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397619&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-14 21:33:47.541 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job×tamp=1768397626 status=200 resp_size=5922
|
||
2026-01-14 21:33:47.824 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397627&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
|
||
2026-01-14 21:33:59.572 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168643127?api_key=51job×tamp=1768397635 status=200 resp_size=6451
|
||
2026-01-14 21:33:59.897 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397639&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-14 21:34:04.237 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job×tamp=1768397641 status=200 resp_size=6659
|
||
2026-01-14 21:34:04.592 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397644&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
|
||
2026-01-14 21:34:14.888 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job×tamp=1768397653 status=200 resp_size=5182
|
||
2026-01-14 21:34:15.111 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397654&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
|
||
2026-01-14 21:34:19.690 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768397659 status=200 resp_size=7336
|
||
2026-01-14 21:34:19.914 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397659&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-14 21:34:23.490 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217934?api_key=51job×tamp=1768397663 status=200 resp_size=7014
|
||
2026-01-14 21:34:23.722 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397663&companyId=7424273&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5514
|
||
2026-01-14 21:34:26.088 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job×tamp=1768397665 status=200 resp_size=5282
|
||
2026-01-14 21:34:26.311 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397666&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
|
||
2026-01-14 21:34:26.312 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 14 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:34:31.528 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:34:31.529 | INFO | __main__:crawl_multiple_pages:1029 - 第 14 页获取到 20 个职位 | 累计: 280 个
|
||
2026-01-14 21:34:39.522 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 7.99 秒后继续...
|
||
2026-01-14 21:34:39.523 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 15/26 页...
|
||
2026-01-14 21:34:39.524 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:34:39.547 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=15, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:34:39.960 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:34:41.092 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:34:43.188 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:34:43.188 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:34:43.679 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397679 status=200 resp_size=123552
|
||
2026-01-14 21:34:43.680 | WARNING | __main__:get_recommend_jobs:743 - 第 15 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:34:43.680 | INFO | __main__:get_recommend_jobs:745 - 第 15 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:34:43.838 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168682041?api_key=51job×tamp=1768397683 status=200 resp_size=6559
|
||
2026-01-14 21:34:43.998 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397683&companyId=5136231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6396
|
||
2026-01-14 21:34:46.319 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168640585?api_key=51job×tamp=1768397686 status=200 resp_size=5510
|
||
2026-01-14 21:34:46.544 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397686&companyId=6274632&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10545
|
||
2026-01-14 21:34:54.128 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job×tamp=1768397693 status=200 resp_size=5673
|
||
2026-01-14 21:34:54.244 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397694&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
|
||
2026-01-14 21:35:02.235 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job×tamp=1768397701 status=200 resp_size=7107
|
||
2026-01-14 21:35:02.462 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397702&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
|
||
2026-01-14 21:35:09.915 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job×tamp=1768397709 status=200 resp_size=7664
|
||
2026-01-14 21:35:10.123 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397709&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
|
||
2026-01-14 21:35:12.134 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job×tamp=1768397711 status=200 resp_size=6652
|
||
2026-01-14 21:35:12.378 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397712&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
|
||
2026-01-14 21:35:19.065 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job×tamp=1768397718 status=200 resp_size=4739
|
||
2026-01-14 21:35:19.304 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397719&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:35:23.220 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job×tamp=1768397722 status=200 resp_size=4926
|
||
2026-01-14 21:35:23.456 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397723&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-14 21:35:26.303 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job×tamp=1768397726 status=200 resp_size=4905
|
||
2026-01-14 21:35:26.533 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397726&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
|
||
2026-01-14 21:35:36.179 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151521?api_key=51job×tamp=1768397735 status=200 resp_size=7399
|
||
2026-01-14 21:35:36.400 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397736&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-14 21:35:38.398 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job×tamp=1768397738 status=200 resp_size=4840
|
||
2026-01-14 21:35:38.626 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397738&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:35:40.840 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job×tamp=1768397740 status=200 resp_size=5006
|
||
2026-01-14 21:35:41.068 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397740&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
|
||
2026-01-14 21:35:44.809 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job×tamp=1768397744 status=200 resp_size=5365
|
||
2026-01-14 21:35:45.036 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397744&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
|
||
2026-01-14 21:35:58.933 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job×tamp=1768397750 status=200 resp_size=5265
|
||
2026-01-14 21:35:59.408 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397758&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
|
||
2026-01-14 21:36:06.421 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job×tamp=1768397766 status=200 resp_size=5262
|
||
2026-01-14 21:36:06.561 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397766&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
|
||
2026-01-14 21:36:07.991 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job×tamp=1768397767 status=200 resp_size=4974
|
||
2026-01-14 21:36:08.121 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397767&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
|
||
2026-01-14 21:36:14.132 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job×tamp=1768397773 status=200 resp_size=7412
|
||
2026-01-14 21:36:14.381 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397774&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-14 21:36:18.224 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169914876?api_key=51job×tamp=1768397777 status=200 resp_size=5105
|
||
2026-01-14 21:36:18.471 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397778&companyId=7725449&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12267
|
||
2026-01-14 21:36:26.210 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job×tamp=1768397785 status=200 resp_size=4861
|
||
2026-01-14 21:36:26.573 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397786&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
|
||
2026-01-14 21:36:26.574 | INFO | __main__:get_recommend_jobs:796 - 准备上报第 15 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:36:31.061 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:36:31.062 | INFO | __main__:crawl_multiple_pages:1029 - 第 15 页获取到 20 个职位 | 累计: 300 个
|
||
2026-01-14 21:36:33.788 | INFO | __main__:crawl_multiple_pages:1043 - 休眠 2.72 秒后继续...
|
||
2026-01-14 21:36:33.788 | INFO | __main__:crawl_multiple_pages:1003 -
|
||
>>> 正在爬取第 16/26 页...
|
||
2026-01-14 21:36:33.789 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:36:33.807 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=16, 页大小=20, 地区=宿州, 工作类型=3413
|
||
2026-01-14 21:36:34.536 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:36:35.750 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:36:37.999 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:36:38.000 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:36:38.560 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397793 status=200 resp_size=134057
|
||
2026-01-14 21:36:38.560 | INFO | __main__:get_recommend_jobs:745 - 第 16 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 宿州(宿州) | 职能: 契约管理(3413)
|
||
2026-01-14 21:36:38.794 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job×tamp=1768397798 status=200 resp_size=5398
|
||
2026-01-14 21:36:39.034 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397798&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
|
||
2026-01-14 21:36:47.517 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job×tamp=1768397807 status=200 resp_size=6333
|
||
2026-01-14 21:36:47.699 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397807&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
|
||
2026-01-14 21:36:59.415 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job×tamp=1768397816 status=200 resp_size=5682
|
||
2026-01-14 21:37:00.097 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397819&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
|
||
2026-01-14 21:37:03.899 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job×tamp=1768397823 status=200 resp_size=6279
|
||
2026-01-14 21:37:05.247 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397823&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
|
||
2026-01-14 21:37:15.716 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job×tamp=1768397834 status=200 resp_size=5470
|
||
2026-01-14 21:37:16.334 | INFO | __main__:crawl_recommend_jobs_main:1221 - 用户中断推荐职位爬取
|
||
2026-01-14 21:37:16.338 | INFO | __main__:close:1135 - httpx客户端已关闭
|
||
2026-01-14 21:37:19.808 | INFO | __main__:crawl_recommend_jobs_main:1172 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:37:19.851 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:37:20.069 | INFO | __main__:crawl_recommend_jobs_main:1206 - 开始爬取推荐职位，最多 50 页
|
||
2026-01-14 21:37:20.069 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
|
||
2026-01-14 21:37:20.069 | INFO | __main__:crawl_multiple_pages:1003 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:37:20.069 | INFO | __main__:crawl_multiple_pages:1004 - ================================================================================
|
||
2026-01-14 21:37:20.070 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 1/50 页...
|
||
2026-01-14 21:37:20.070 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:37:20.080 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=1, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:37:20.914 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:37:22.119 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:37:24.377 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:37:24.377 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:37:24.929 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397840 status=200 resp_size=111954
|
||
2026-01-14 21:37:24.930 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 1 页 jobIds 预览: ['115092218', '160369868', '160371871', '160370349', '170271546']
|
||
2026-01-14 21:37:24.931 | INFO | __main__:get_recommend_jobs:749 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:37:25.186 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job×tamp=1768397844 status=200 resp_size=5029
|
||
2026-01-14 21:37:25.420 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397845&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
|
||
2026-01-14 21:37:32.136 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job×tamp=1768397851 status=200 resp_size=5589
|
||
2026-01-14 21:37:32.378 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397852&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:37:47.382 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job×tamp=1768397862 status=200 resp_size=5194
|
||
2026-01-14 21:37:47.977 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397867&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:37:50.779 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job×tamp=1768397870 status=200 resp_size=5556
|
||
2026-01-14 21:37:51.179 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397870&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:37:57.079 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170271546?api_key=51job×tamp=1768397876 status=200 resp_size=5864
|
||
2026-01-14 21:37:57.275 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397877&companyId=10151561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2689
|
||
2026-01-14 21:38:07.341 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job×tamp=1768397886 status=200 resp_size=5022
|
||
2026-01-14 21:38:07.649 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397887&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
|
||
2026-01-14 21:38:15.856 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job×tamp=1768397895 status=200 resp_size=5640
|
||
2026-01-14 21:38:15.994 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397895&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
|
||
2026-01-14 21:38:23.834 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job×tamp=1768397902 status=200 resp_size=5769
|
||
2026-01-14 21:38:24.075 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397903&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
|
||
2026-01-14 21:38:33.018 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170263138?api_key=51job×tamp=1768397912 status=200 resp_size=6660
|
||
2026-01-14 21:38:33.167 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397913&companyId=10152513&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6465
|
||
2026-01-14 21:38:39.748 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job×tamp=1768397918 status=200 resp_size=6192
|
||
2026-01-14 21:38:39.984 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397919&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 21:38:47.083 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job×tamp=1768397926 status=200 resp_size=5738
|
||
2026-01-14 21:38:47.312 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397927&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:38:50.217 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162162131?api_key=51job×tamp=1768397929 status=200 resp_size=6210
|
||
2026-01-14 21:38:50.461 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397930&companyId=9397290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6834
|
||
2026-01-14 21:38:56.231 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job×tamp=1768397935 status=200 resp_size=5653
|
||
2026-01-14 21:38:56.369 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397936&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
|
||
2026-01-14 21:39:04.680 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job×tamp=1768397943 status=200 resp_size=5888
|
||
2026-01-14 21:39:05.003 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397944&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:39:11.355 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job×tamp=1768397950 status=200 resp_size=4918
|
||
2026-01-14 21:39:11.534 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397951&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
|
||
2026-01-14 21:39:19.056 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job×tamp=1768397958 status=200 resp_size=5466
|
||
2026-01-14 21:39:19.323 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397959&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
|
||
2026-01-14 21:39:20.529 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210093?api_key=51job×tamp=1768397960 status=200 resp_size=6032
|
||
2026-01-14 21:39:20.658 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397960&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:39:28.259 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job×tamp=1768397967 status=200 resp_size=6021
|
||
2026-01-14 21:39:28.386 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397968&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:39:40.450 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job×tamp=1768397978 status=200 resp_size=6046
|
||
2026-01-14 21:39:40.750 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397980&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:39:48.212 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631937?api_key=51job×tamp=1768397987 status=200 resp_size=5679
|
||
2026-01-14 21:39:48.396 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768397988&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:39:48.396 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:39:48.527 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:39:48.527 | INFO | __main__:crawl_multiple_pages:1029 - 检测到API返回totalCount: 508 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
|
||
2026-01-14 21:39:48.528 | INFO | __main__:crawl_multiple_pages:1033 - 第 1 页获取到 20 个职位 | 累计: 20 个
|
||
2026-01-14 21:39:55.735 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 7.20 秒后继续...
|
||
2026-01-14 21:39:55.735 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 2/26 页...
|
||
2026-01-14 21:39:55.737 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:39:55.763 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=2, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:39:56.654 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:39:57.855 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:40:00.047 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:40:00.048 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:40:00.577 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768397995 status=200 resp_size=105689
|
||
2026-01-14 21:40:00.578 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 2 页 jobIds 预览: ['170248262', '167697904', '163080620', '165612676', '162880059']
|
||
2026-01-14 21:40:00.578 | INFO | __main__:get_recommend_jobs:749 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:40:00.808 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170248262?api_key=51job×tamp=1768398000 status=200 resp_size=6167
|
||
2026-01-14 21:40:01.027 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398000&companyId=10145962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2918
|
||
2026-01-14 21:40:03.465 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job×tamp=1768398003 status=200 resp_size=5739
|
||
2026-01-14 21:40:03.703 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398003&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
|
||
2026-01-14 21:40:10.159 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job×tamp=1768398009 status=200 resp_size=5585
|
||
2026-01-14 21:40:10.298 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398010&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
|
||
2026-01-14 21:40:19.890 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job×tamp=1768398018 status=200 resp_size=6332
|
||
2026-01-14 21:40:20.198 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398019&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4683
|
||
2026-01-14 21:40:23.479 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job×tamp=1768398023 status=200 resp_size=4913
|
||
2026-01-14 21:40:23.712 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398023&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|
||
2026-01-14 21:40:28.746 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job×tamp=1768398028 status=200 resp_size=5502
|
||
2026-01-14 21:40:28.985 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398028&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
|
||
2026-01-14 21:40:39.787 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job×tamp=1768398038 status=200 resp_size=5196
|
||
2026-01-14 21:40:40.034 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398039&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
|
||
2026-01-14 21:40:48.102 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job×tamp=1768398047 status=200 resp_size=6134
|
||
2026-01-14 21:40:48.345 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398048&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
|
||
2026-01-14 21:40:53.401 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job×tamp=1768398053 status=200 resp_size=4984
|
||
2026-01-14 21:40:53.652 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398053&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
|
||
2026-01-14 21:41:00.211 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job×tamp=1768398059 status=200 resp_size=5609
|
||
2026-01-14 21:41:00.354 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398060&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
|
||
2026-01-14 21:41:07.636 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job×tamp=1768398066 status=200 resp_size=5128
|
||
2026-01-14 21:41:07.843 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398067&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
|
||
2026-01-14 21:41:10.959 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job×tamp=1768398070 status=200 resp_size=5970
|
||
2026-01-14 21:41:11.136 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398070&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
|
||
2026-01-14 21:41:14.482 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170264772?api_key=51job×tamp=1768398074 status=200 resp_size=6220
|
||
2026-01-14 21:41:14.660 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398074&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 21:41:24.549 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job×tamp=1768398082 status=200 resp_size=5623
|
||
2026-01-14 21:41:24.890 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398084&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:41:32.499 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job×tamp=1768398091 status=200 resp_size=5372
|
||
2026-01-14 21:41:32.731 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398092&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:41:39.425 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job×tamp=1768398098 status=200 resp_size=5484
|
||
2026-01-14 21:41:39.841 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398099&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
|
||
2026-01-14 21:41:42.314 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234488?api_key=51job×tamp=1768398101 status=200 resp_size=8595
|
||
2026-01-14 21:41:42.533 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398102&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 21:41:46.870 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job×tamp=1768398106 status=200 resp_size=5612
|
||
2026-01-14 21:41:47.009 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398106&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 21:41:53.324 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job×tamp=1768398112 status=200 resp_size=5704
|
||
2026-01-14 21:41:53.560 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398113&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:41:57.369 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job×tamp=1768398117 status=200 resp_size=5519
|
||
2026-01-14 21:41:57.616 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398117&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 21:41:57.616 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:41:57.708 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:41:57.709 | INFO | __main__:crawl_multiple_pages:1033 - 第 2 页获取到 20 个职位 | 累计: 40 个
|
||
2026-01-14 21:42:00.457 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 2.74 秒后继续...
|
||
2026-01-14 21:42:00.457 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 3/26 页...
|
||
2026-01-14 21:42:00.458 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:42:00.475 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=3, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:42:01.771 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:42:05.410 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:42:07.848 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:42:07.849 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:42:08.394 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398120 status=200 resp_size=114147
|
||
2026-01-14 21:42:08.394 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 3 页 jobIds 预览: ['170252560', '169115852', '167246198', '170210409', '170261099']
|
||
2026-01-14 21:42:08.395 | INFO | __main__:get_recommend_jobs:749 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:42:09.844 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170252560?api_key=51job×tamp=1768398128 status=200 resp_size=7065
|
||
2026-01-14 21:42:10.166 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398129&companyId=10150178&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3650
|
||
2026-01-14 21:42:15.451 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169115852?api_key=51job×tamp=1768398135 status=200 resp_size=6076
|
||
2026-01-14 21:42:16.510 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398135&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
|
||
2026-01-14 21:42:26.413 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job×tamp=1768398145 status=200 resp_size=5659
|
||
2026-01-14 21:42:26.658 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398146&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
|
||
2026-01-14 21:42:33.126 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job×tamp=1768398151 status=200 resp_size=5531
|
||
2026-01-14 21:42:33.256 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398153&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
|
||
2026-01-14 21:42:35.685 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170261099?api_key=51job×tamp=1768398155 status=200 resp_size=6148
|
||
2026-01-14 21:42:35.808 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398155&companyId=10151948&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2587
|
||
2026-01-14 21:42:44.329 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job×tamp=1768398163 status=200 resp_size=6312
|
||
2026-01-14 21:42:45.631 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398164&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
|
||
2026-01-14 21:42:50.772 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job×tamp=1768398170 status=200 resp_size=5127
|
||
2026-01-14 21:42:50.965 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398170&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
|
||
2026-01-14 21:42:53.561 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job×tamp=1768398173 status=200 resp_size=5202
|
||
2026-01-14 21:42:53.749 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398173&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
|
||
2026-01-14 21:43:02.786 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job×tamp=1768398182 status=200 resp_size=5703
|
||
2026-01-14 21:43:02.968 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398182&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-14 21:43:07.363 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job×tamp=1768398187 status=200 resp_size=6003
|
||
2026-01-14 21:43:07.549 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398187&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
|
||
2026-01-14 21:43:19.869 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job×tamp=1768398197 status=200 resp_size=5339
|
||
2026-01-14 21:43:20.169 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398199&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:43:29.294 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job×tamp=1768398208 status=200 resp_size=5734
|
||
2026-01-14 21:43:29.564 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398209&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
|
||
2026-01-14 21:43:31.418 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job×tamp=1768398211 status=200 resp_size=6702
|
||
2026-01-14 21:43:31.680 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398211&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
|
||
2026-01-14 21:43:40.363 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job×tamp=1768398219 status=200 resp_size=5727
|
||
2026-01-14 21:43:40.598 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398220&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:43:45.652 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168415691?api_key=51job×tamp=1768398225 status=200 resp_size=5247
|
||
2026-01-14 21:43:45.901 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398225&companyId=9419912&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 21:43:54.741 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job×tamp=1768398233 status=200 resp_size=5733
|
||
2026-01-14 21:43:54.938 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398234&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
|
||
2026-01-14 21:44:02.509 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170234315?api_key=51job×tamp=1768398241 status=200 resp_size=7151
|
||
2026-01-14 21:44:02.680 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398242&companyId=8371858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5414
|
||
2026-01-14 21:44:13.300 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job×tamp=1768398252 status=200 resp_size=6025
|
||
2026-01-14 21:44:13.483 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398253&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
|
||
2026-01-14 21:44:20.950 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job×tamp=1768398260 status=200 resp_size=5243
|
||
2026-01-14 21:44:21.203 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398260&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
|
||
2026-01-14 21:44:30.152 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166476843?api_key=51job×tamp=1768398269 status=200 resp_size=6147
|
||
2026-01-14 21:44:30.311 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398270&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
|
||
2026-01-14 21:44:30.311 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:44:30.428 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:44:30.428 | INFO | __main__:crawl_multiple_pages:1033 - 第 3 页获取到 20 个职位 | 累计: 60 个
|
||
2026-01-14 21:44:36.379 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 5.95 秒后继续...
|
||
2026-01-14 21:44:36.379 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 4/26 页...
|
||
2026-01-14 21:44:36.379 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:44:36.393 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=4, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:44:37.302 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:44:38.512 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:44:40.712 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:44:40.713 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:44:41.215 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398276 status=200 resp_size=121437
|
||
2026-01-14 21:44:41.215 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 4 页 jobIds 预览: ['170234315', '166890851', '164041266', '166865703', '169830137']
|
||
2026-01-14 21:44:41.215 | WARNING | __main__:get_recommend_jobs:747 - 第 4 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:44:41.215 | INFO | __main__:get_recommend_jobs:749 - 第 4 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:44:41.446 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job×tamp=1768398281 status=200 resp_size=6657
|
||
2026-01-14 21:44:41.691 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398281&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:44:48.905 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job×tamp=1768398287 status=200 resp_size=5827
|
||
2026-01-14 21:44:49.172 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398288&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:44:54.554 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job×tamp=1768398294 status=200 resp_size=6454
|
||
2026-01-14 21:44:54.696 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398294&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:44:56.265 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job×tamp=1768398296 status=200 resp_size=5893
|
||
2026-01-14 21:44:56.411 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398296&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5461
|
||
2026-01-14 21:45:05.422 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job×tamp=1768398304 status=200 resp_size=6487
|
||
2026-01-14 21:45:05.655 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398305&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:45:14.621 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job×tamp=1768398314 status=200 resp_size=5787
|
||
2026-01-14 21:45:14.770 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398314&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:45:24.355 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job×tamp=1768398323 status=200 resp_size=5824
|
||
2026-01-14 21:45:24.590 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398324&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:45:32.097 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job×tamp=1768398331 status=200 resp_size=5621
|
||
2026-01-14 21:45:32.362 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398332&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13642
|
||
2026-01-14 21:45:34.166 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job×tamp=1768398333 status=200 resp_size=5961
|
||
2026-01-14 21:45:34.428 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398334&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:45:41.401 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job×tamp=1768398340 status=200 resp_size=6398
|
||
2026-01-14 21:45:41.625 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398341&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:45:46.762 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job×tamp=1768398344 status=200 resp_size=6043
|
||
2026-01-14 21:45:47.021 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398346&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:45:51.440 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job×tamp=1768398351 status=200 resp_size=7980
|
||
2026-01-14 21:45:51.662 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398351&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7841
|
||
2026-01-14 21:46:00.678 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job×tamp=1768398359 status=200 resp_size=6523
|
||
2026-01-14 21:46:00.940 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398360&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7953
|
||
2026-01-14 21:46:04.715 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job×tamp=1768398364 status=200 resp_size=5934
|
||
2026-01-14 21:46:04.945 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398364&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:46:13.320 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job×tamp=1768398372 status=200 resp_size=4058
|
||
2026-01-14 21:46:13.668 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398373&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
|
||
2026-01-14 21:46:18.793 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job×tamp=1768398378 status=200 resp_size=5798
|
||
2026-01-14 21:46:19.026 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398378&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:46:27.482 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job×tamp=1768398386 status=200 resp_size=6191
|
||
2026-01-14 21:46:27.738 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398387&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 21:46:38.134 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job×tamp=1768398397 status=200 resp_size=5226
|
||
2026-01-14 21:46:38.362 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398398&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:46:47.330 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job×tamp=1768398406 status=200 resp_size=6146
|
||
2026-01-14 21:46:47.457 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398407&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:46:47.458 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 4 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:46:52.303 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:46:52.304 | INFO | __main__:crawl_multiple_pages:1033 - 第 4 页获取到 20 个职位 | 累计: 80 个
|
||
2026-01-14 21:46:55.412 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 3.11 秒后继续...
|
||
2026-01-14 21:46:55.413 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 5/26 页...
|
||
2026-01-14 21:46:55.413 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:46:55.432 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=5, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:46:56.916 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:46:58.014 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:47:00.109 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:47:00.109 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:47:00.640 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398415 status=200 resp_size=143613
|
||
2026-01-14 21:47:00.640 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 5 页 jobIds 预览: ['164483017', '166339728', '163954601', '163286165', '170224028']
|
||
2026-01-14 21:47:00.641 | INFO | __main__:get_recommend_jobs:749 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:47:00.763 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164483017?api_key=51job×tamp=1768398420 status=200 resp_size=5994
|
||
2026-01-14 21:47:00.887 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398420&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:47:06.872 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job×tamp=1768398425 status=200 resp_size=6069
|
||
2026-01-14 21:47:07.110 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398426&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
|
||
2026-01-14 21:47:16.678 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job×tamp=1768398435 status=200 resp_size=5628
|
||
2026-01-14 21:47:16.921 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398436&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:47:20.151 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job×tamp=1768398439 status=200 resp_size=5476
|
||
2026-01-14 21:47:20.377 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398440&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
|
||
2026-01-14 21:47:25.589 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224028?api_key=51job×tamp=1768398445 status=200 resp_size=6206
|
||
2026-01-14 21:47:25.822 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398445&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-14 21:47:32.108 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job×tamp=1768398451 status=200 resp_size=5882
|
||
2026-01-14 21:47:32.402 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398452&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
|
||
2026-01-14 21:47:38.710 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170241950?api_key=51job×tamp=1768398458 status=200 resp_size=7558
|
||
2026-01-14 21:47:39.044 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398458&companyId=3759935&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4475
|
||
2026-01-14 21:47:45.186 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job×tamp=1768398464 status=200 resp_size=5990
|
||
2026-01-14 21:47:45.431 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398465&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:47:49.428 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170169729?api_key=51job×tamp=1768398469 status=200 resp_size=5524
|
||
2026-01-14 21:47:49.670 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398469&companyId=6739400&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4204
|
||
2026-01-14 21:47:58.284 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job×tamp=1768398477 status=200 resp_size=7768
|
||
2026-01-14 21:47:58.546 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398478&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 21:47:59.877 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138503?api_key=51job×tamp=1768398479 status=200 resp_size=5411
|
||
2026-01-14 21:48:00.090 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398479&companyId=3604901&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4847
|
||
2026-01-14 21:48:03.511 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168507322?api_key=51job×tamp=1768398483 status=200 resp_size=5853
|
||
2026-01-14 21:48:03.698 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398483&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:48:12.502 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147360237?api_key=51job×tamp=1768398492 status=200 resp_size=5695
|
||
2026-01-14 21:48:12.644 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398492&companyId=2717589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7967
|
||
2026-01-14 21:48:23.327 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job×tamp=1768398502 status=200 resp_size=6336
|
||
2026-01-14 21:48:23.589 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398503&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
|
||
2026-01-14 21:48:31.395 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job×tamp=1768398510 status=200 resp_size=7326
|
||
2026-01-14 21:48:32.002 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398511&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11130
|
||
2026-01-14 21:48:43.909 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job×tamp=1768398521 status=200 resp_size=6529
|
||
2026-01-14 21:48:44.253 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398523&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:48:50.438 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job×tamp=1768398529 status=200 resp_size=7519
|
||
2026-01-14 21:48:50.702 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398530&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
|
||
2026-01-14 21:48:52.834 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170144314?api_key=51job×tamp=1768398532 status=200 resp_size=6449
|
||
2026-01-14 21:48:53.069 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398532&companyId=7188726&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5931
|
||
2026-01-14 21:48:54.914 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job×tamp=1768398534 status=200 resp_size=8382
|
||
2026-01-14 21:48:55.189 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398534&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
|
||
2026-01-14 21:49:05.120 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job×tamp=1768398544 status=200 resp_size=5764
|
||
2026-01-14 21:49:05.265 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398545&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:49:05.266 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:49:10.376 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:49:10.376 | INFO | __main__:crawl_multiple_pages:1033 - 第 5 页获取到 20 个职位 | 累计: 100 个
|
||
2026-01-14 21:49:15.516 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 5.14 秒后继续...
|
||
2026-01-14 21:49:15.517 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 6/26 页...
|
||
2026-01-14 21:49:15.519 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:49:15.541 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=6, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:49:18.128 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:49:19.329 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:49:21.580 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:49:21.580 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:49:22.283 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398555 status=200 resp_size=133724
|
||
2026-01-14 21:49:22.283 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 6 页 jobIds 预览: ['169955817', '157341893', '168834342', '170050033', '142783157']
|
||
2026-01-14 21:49:22.283 | WARNING | __main__:get_recommend_jobs:747 - 第 6 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:49:22.283 | INFO | __main__:get_recommend_jobs:749 - 第 6 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:49:22.689 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955817?api_key=51job×tamp=1768398562 status=200 resp_size=6434
|
||
2026-01-14 21:49:23.347 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398562&companyId=2610788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8203
|
||
2026-01-14 21:49:32.895 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157341893?api_key=51job×tamp=1768398572 status=200 resp_size=5894
|
||
2026-01-14 21:49:33.111 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398572&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:49:37.499 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job×tamp=1768398577 status=200 resp_size=6137
|
||
2026-01-14 21:49:37.691 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398577&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:49:40.467 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job×tamp=1768398580 status=200 resp_size=6033
|
||
2026-01-14 21:49:40.601 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398580&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
|
||
2026-01-14 21:49:48.961 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job×tamp=1768398586 status=200 resp_size=6874
|
||
2026-01-14 21:49:49.315 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398588&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8401
|
||
2026-01-14 21:50:00.016 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job×tamp=1768398598 status=200 resp_size=6485
|
||
2026-01-14 21:50:00.233 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398600&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:50:07.616 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job×tamp=1768398607 status=200 resp_size=7105
|
||
2026-01-14 21:50:07.863 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398607&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-14 21:50:14.115 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job×tamp=1768398613 status=200 resp_size=6733
|
||
2026-01-14 21:50:14.401 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398614&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
|
||
2026-01-14 21:50:25.147 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job×tamp=1768398623 status=200 resp_size=6585
|
||
2026-01-14 21:50:25.566 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398625&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 21:50:35.086 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job×tamp=1768398631 status=200 resp_size=6733
|
||
2026-01-14 21:50:35.317 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398635&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
|
||
2026-01-14 21:50:43.493 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154300057?api_key=51job×tamp=1768398642 status=200 resp_size=5863
|
||
2026-01-14 21:50:43.759 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398643&companyId=5980412&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10020
|
||
2026-01-14 21:50:47.962 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job×tamp=1768398647 status=200 resp_size=5241
|
||
2026-01-14 21:50:48.208 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398647&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12319
|
||
2026-01-14 21:50:51.526 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job×tamp=1768398651 status=200 resp_size=5439
|
||
2026-01-14 21:50:51.785 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398651&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:50:56.580 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job×tamp=1768398656 status=200 resp_size=5964
|
||
2026-01-14 21:50:56.832 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398656&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 21:50:58.279 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job×tamp=1768398658 status=200 resp_size=6387
|
||
2026-01-14 21:50:58.517 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398658&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
|
||
2026-01-14 21:51:02.742 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job×tamp=1768398662 status=200 resp_size=6431
|
||
2026-01-14 21:51:02.982 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398662&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 21:51:04.375 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job×tamp=1768398664 status=200 resp_size=5708
|
||
2026-01-14 21:51:04.622 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398664&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:51:11.134 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job×tamp=1768398670 status=200 resp_size=5806
|
||
2026-01-14 21:51:11.362 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398671&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
|
||
2026-01-14 21:51:20.065 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job×tamp=1768398676 status=200 resp_size=7206
|
||
2026-01-14 21:51:20.246 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398680&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
|
||
2026-01-14 21:51:20.247 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 6 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:51:20.350 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:51:20.350 | INFO | __main__:crawl_multiple_pages:1033 - 第 6 页获取到 20 个职位 | 累计: 120 个
|
||
2026-01-14 21:51:26.931 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 6.58 秒后继续...
|
||
2026-01-14 21:51:26.932 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 7/26 页...
|
||
2026-01-14 21:51:26.933 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:51:26.956 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=7, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:51:27.801 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:51:29.015 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:51:31.223 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:51:31.223 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:51:31.789 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398686 status=200 resp_size=157326
|
||
2026-01-14 21:51:31.789 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 7 页 jobIds 预览: ['140194322', '169755029', '170145793', '115564872', '167428606']
|
||
2026-01-14 21:51:31.789 | WARNING | __main__:get_recommend_jobs:747 - 第 7 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:51:31.789 | INFO | __main__:get_recommend_jobs:749 - 第 7 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:51:32.051 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job×tamp=1768398691 status=200 resp_size=7276
|
||
2026-01-14 21:51:32.320 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398692&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
|
||
2026-01-14 21:51:42.525 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job×tamp=1768398701 status=200 resp_size=6980
|
||
2026-01-14 21:51:42.718 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398702&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:51:44.787 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170145793?api_key=51job×tamp=1768398704 status=200 resp_size=7292
|
||
2026-01-14 21:51:45.973 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398704&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 21:51:54.584 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115564872?api_key=51job×tamp=1768398713 status=200 resp_size=6364
|
||
2026-01-14 21:51:54.794 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398714&companyId=2909774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10755
|
||
2026-01-14 21:52:01.798 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167428606?api_key=51job×tamp=1768398720 status=200 resp_size=5635
|
||
2026-01-14 21:52:02.051 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398721&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-14 21:52:08.333 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job×tamp=1768398727 status=200 resp_size=6570
|
||
2026-01-14 21:52:08.597 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398728&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:52:11.820 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169431874?api_key=51job×tamp=1768398731 status=200 resp_size=7985
|
||
2026-01-14 21:52:11.976 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398731&companyId=8298774&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3077
|
||
2026-01-14 21:52:18.030 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job×tamp=1768398737 status=200 resp_size=7141
|
||
2026-01-14 21:52:18.232 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398738&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-14 21:52:25.917 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job×tamp=1768398745 status=200 resp_size=6417
|
||
2026-01-14 21:52:26.127 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398745&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:52:29.376 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150031953?api_key=51job×tamp=1768398749 status=200 resp_size=7985
|
||
2026-01-14 21:52:29.573 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398749&companyId=2110297&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11364
|
||
2026-01-14 21:52:32.097 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job×tamp=1768398751 status=200 resp_size=6452
|
||
2026-01-14 21:52:32.377 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398752&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
|
||
2026-01-14 21:52:51.909 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job×tamp=1768398762 status=200 resp_size=6736
|
||
2026-01-14 21:52:54.932 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398771&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
|
||
2026-01-14 21:52:59.825 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job×tamp=1768398778 status=200 resp_size=5518
|
||
2026-01-14 21:53:01.221 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398779&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:53:10.817 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job×tamp=1768398790 status=200 resp_size=6198
|
||
2026-01-14 21:53:10.988 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398790&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
|
||
2026-01-14 21:53:19.039 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job×tamp=1768398798 status=200 resp_size=5787
|
||
2026-01-14 21:53:19.286 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398799&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
|
||
2026-01-14 21:53:21.531 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job×tamp=1768398801 status=200 resp_size=13124
|
||
2026-01-14 21:53:21.813 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398801&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
|
||
2026-01-14 21:53:30.826 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job×tamp=1768398810 status=200 resp_size=6707
|
||
2026-01-14 21:53:31.003 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398810&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:53:38.582 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job×tamp=1768398817 status=200 resp_size=5140
|
||
2026-01-14 21:53:38.776 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398818&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
|
||
2026-01-14 21:53:40.645 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170226133?api_key=51job×tamp=1768398820 status=200 resp_size=6380
|
||
2026-01-14 21:53:40.854 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398820&companyId=10149145&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8629
|
||
2026-01-14 21:53:40.854 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 7 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 21:53:40.994 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 21:53:40.995 | INFO | __main__:crawl_multiple_pages:1033 - 第 7 页获取到 20 个职位 | 累计: 140 个
|
||
2026-01-14 21:53:49.943 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 8.94 秒后继续...
|
||
2026-01-14 21:53:49.944 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 8/26 页...
|
||
2026-01-14 21:53:49.945 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:53:49.964 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=8, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:53:51.164 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:53:52.518 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:53:54.743 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:53:54.743 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:53:55.401 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398829 status=200 resp_size=146032
|
||
2026-01-14 21:53:55.401 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 8 页 jobIds 预览: ['170083146', '169950080', '169989833', '162985205', '169948859']
|
||
2026-01-14 21:53:55.402 | INFO | __main__:get_recommend_jobs:749 - 第 8 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 508 (原始值: 508) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:53:55.671 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job×tamp=1768398835 status=200 resp_size=6539
|
||
2026-01-14 21:53:55.994 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398835&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
|
||
2026-01-14 21:54:05.328 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job×tamp=1768398843 status=200 resp_size=6302
|
||
2026-01-14 21:54:05.587 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398845&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:54:13.528 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job×tamp=1768398852 status=200 resp_size=7415
|
||
2026-01-14 21:54:13.721 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398853&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10593
|
||
2026-01-14 21:54:21.351 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162985205?api_key=51job×tamp=1768398860 status=200 resp_size=5170
|
||
2026-01-14 21:54:21.610 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398861&companyId=9470811&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-14 21:54:25.294 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job×tamp=1768398865 status=200 resp_size=5951
|
||
2026-01-14 21:54:25.513 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398865&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
|
||
2026-01-14 21:54:27.224 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817280?api_key=51job×tamp=1768398866 status=200 resp_size=6398
|
||
2026-01-14 21:54:27.530 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398867&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:54:34.039 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job×tamp=1768398873 status=200 resp_size=6037
|
||
2026-01-14 21:54:34.225 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398874&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
|
||
2026-01-14 21:54:35.553 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job×tamp=1768398875 status=200 resp_size=5119
|
||
2026-01-14 21:54:35.773 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398875&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-14 21:54:45.904 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job×tamp=1768398884 status=200 resp_size=7949
|
||
2026-01-14 21:54:46.221 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398885&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
|
||
2026-01-14 21:54:56.422 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job×tamp=1768398895 status=200 resp_size=6276
|
||
2026-01-14 21:54:56.592 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398896&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:54:57.857 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job×tamp=1768398897 status=200 resp_size=5458
|
||
2026-01-14 21:54:58.033 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398897&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
|
||
2026-01-14 21:55:05.072 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job×tamp=1768398903 status=200 resp_size=5130
|
||
2026-01-14 21:55:05.293 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398905&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
|
||
2026-01-14 21:55:11.845 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job×tamp=1768398910 status=200 resp_size=5744
|
||
2026-01-14 21:55:12.068 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398911&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10811
|
||
2026-01-14 21:55:19.601 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873480?api_key=51job×tamp=1768398918 status=200 resp_size=7118
|
||
2026-01-14 21:55:19.827 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398919&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:55:27.184 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job×tamp=1768398926 status=200 resp_size=7005
|
||
2026-01-14 21:55:27.394 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398927&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
|
||
2026-01-14 21:55:28.907 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162163569?api_key=51job×tamp=1768398928 status=200 resp_size=7717
|
||
2026-01-14 21:55:29.129 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398928&companyId=5974966&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7138
|
||
2026-01-14 21:55:32.559 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168137612?api_key=51job×tamp=1768398932 status=200 resp_size=8734
|
||
2026-01-14 21:55:32.784 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398932&companyId=2649251&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8680
|
||
2026-01-14 21:55:36.570 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job×tamp=1768398936 status=200 resp_size=8830
|
||
2026-01-14 21:55:36.970 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398936&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:55:41.855 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job×tamp=1768398941 status=200 resp_size=7353
|
||
2026-01-14 21:55:42.140 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398941&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
|
||
2026-01-14 21:55:51.841 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job×tamp=1768398950 status=200 resp_size=5719
|
||
2026-01-14 21:55:52.141 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398951&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7177
|
||
2026-01-14 21:55:52.141 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 8 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 21:55:52.230 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 21:55:52.230 | INFO | __main__:crawl_multiple_pages:1033 - 第 8 页获取到 20 个职位 | 累计: 160 个
|
||
2026-01-14 21:55:56.884 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 4.65 秒后继续...
|
||
2026-01-14 21:55:56.885 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 9/26 页...
|
||
2026-01-14 21:55:56.886 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 21:55:56.906 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=9, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 21:55:57.951 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:55:59.371 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:56:01.499 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 21:56:01.500 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 21:56:02.051 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768398956 status=200 resp_size=140238
|
||
2026-01-14 21:56:02.052 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 9 页 jobIds 预览: ['170026907', '170262084', '170194059', '165056159', '170120883']
|
||
2026-01-14 21:56:02.052 | WARNING | __main__:get_recommend_jobs:747 - 第 9 页发现 1 个重复职位（已跳过）
|
||
2026-01-14 21:56:02.052 | INFO | __main__:get_recommend_jobs:749 - 第 9 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 507 (原始值: 507) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 21:56:02.285 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170262084?api_key=51job×tamp=1768398962 status=200 resp_size=5538
|
||
2026-01-14 21:56:02.455 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768398962&companyId=10152578&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2979
|
||
2026-01-14 21:57:01.904 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194059?api_key=51job×tamp=1768398969 status=200 resp_size=5928
|
||
2026-01-14 21:57:11.963 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399021&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:57:49.055 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165056159?api_key=51job×tamp=1768399039 status=200 resp_size=5564
|
||
2026-01-14 21:57:57.137 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399069&companyId=9263792&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9145
|
||
2026-01-14 21:58:05.364 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job×tamp=1768399081 status=200 resp_size=6531
|
||
2026-01-14 21:58:08.328 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399085&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7947
|
||
2026-01-14 21:58:14.962 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169451628?api_key=51job×tamp=1768399093 status=200 resp_size=5476
|
||
2026-01-14 21:58:15.223 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399094&companyId=9959741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5617
|
||
2026-01-14 21:58:29.942 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job×tamp=1768399102 status=200 resp_size=6463
|
||
2026-01-14 21:58:31.473 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399109&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:58:46.657 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170223179?api_key=51job×tamp=1768399120 status=200 resp_size=7255
|
||
2026-01-14 21:58:47.221 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399126&companyId=3806232&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5938
|
||
2026-01-14 21:58:55.230 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job×tamp=1768399132 status=200 resp_size=5364
|
||
2026-01-14 21:58:56.222 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399135&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
|
||
2026-01-14 21:59:04.822 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job×tamp=1768399144 status=200 resp_size=5425
|
||
2026-01-14 21:59:05.362 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399144&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-14 21:59:14.846 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job×tamp=1768399153 status=200 resp_size=5017
|
||
2026-01-14 21:59:15.224 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399154&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:59:19.437 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140565957?api_key=51job×tamp=1768399159 status=200 resp_size=7625
|
||
2026-01-14 21:59:19.676 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399159&companyId=6817609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4394
|
||
2026-01-14 21:59:29.790 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job×tamp=1768399168 status=200 resp_size=7215
|
||
2026-01-14 21:59:30.012 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399169&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7966
|
||
2026-01-14 21:59:36.718 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job×tamp=1768399175 status=200 resp_size=6519
|
||
2026-01-14 21:59:37.150 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399176&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 21:59:44.440 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168589858?api_key=51job×tamp=1768399183 status=200 resp_size=6688
|
||
2026-01-14 21:59:44.627 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399184&companyId=9606926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2722
|
||
2026-01-14 21:59:53.687 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job×tamp=1768399192 status=200 resp_size=5495
|
||
2026-01-14 21:59:53.903 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399193&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
|
||
2026-01-14 22:00:16.671 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job×tamp=1768399199 status=200 resp_size=6479
|
||
2026-01-14 22:00:21.430 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399216&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
|
||
2026-01-14 22:00:27.495 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168941480?api_key=51job×tamp=1768399226 status=200 resp_size=5699
|
||
2026-01-14 22:00:27.942 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399227&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:00:34.928 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job×tamp=1768399233 status=200 resp_size=5925
|
||
2026-01-14 22:00:35.188 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399234&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10779
|
||
2026-01-14 22:01:22.847 | ERROR | __main__:_make_request:630 - 请求异常 (尝试 1/3): _ssl.c:1011: The handshake operation timed out
|
||
2026-01-14 22:01:22.848 | WARNING | __main__:_make_request:635 - 检测到代理相关异常: _ssl.c:1011: The handshake operation timed out
|
||
2026-01-14 22:01:22.848 | WARNING | __main__:_switch_proxy_and_reinit:421 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 22:01:22.848 | WARNING | __main__:mark_proxy_failed:202 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
|
||
2026-01-14 22:01:22.848 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 22:01:23.443 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job×tamp=1768399242 status=200 resp_size=7762
|
||
2026-01-14 22:01:23.643 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399283&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11332
|
||
2026-01-14 22:01:23.643 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 9 页数据，包含详细信息的数据条数: 19
|
||
2026-01-14 22:01:28.402 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
|
||
2026-01-14 22:01:28.402 | INFO | __main__:crawl_multiple_pages:1033 - 第 9 页获取到 20 个职位 | 累计: 180 个
|
||
2026-01-14 22:01:34.376 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 5.97 秒后继续...
|
||
2026-01-14 22:01:34.376 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 10/26 页...
|
||
2026-01-14 22:01:34.376 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 22:01:34.390 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=10, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 22:01:34.933 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:01:36.065 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:01:38.194 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:01:38.194 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 22:01:38.669 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768399294 status=200 resp_size=151067
|
||
2026-01-14 22:01:38.670 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 10 页 jobIds 预览: ['170086850', '170195716', '170182281', '134935273', '169851423']
|
||
2026-01-14 22:01:38.670 | INFO | __main__:get_recommend_jobs:749 - 第 10 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 507 (原始值: 507) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 22:01:38.820 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job×tamp=1768399298 status=200 resp_size=8475
|
||
2026-01-14 22:01:38.994 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399298&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:01:41.347 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job×tamp=1768399301 status=200 resp_size=8331
|
||
2026-01-14 22:01:41.517 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399301&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
|
||
2026-01-14 22:01:48.111 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182281?api_key=51job×tamp=1768399307 status=200 resp_size=5424
|
||
2026-01-14 22:01:48.552 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399308&companyId=233377&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11254
|
||
2026-01-14 22:01:57.480 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job×tamp=1768399316 status=200 resp_size=8995
|
||
2026-01-14 22:01:57.669 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399317&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7458
|
||
2026-01-14 22:02:06.425 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job×tamp=1768399325 status=200 resp_size=6762
|
||
2026-01-14 22:02:06.972 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399326&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:03:15.154 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job×tamp=1768399333 status=200 resp_size=6706
|
||
2026-01-14 22:03:23.445 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399395&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
|
||
2026-01-14 22:03:31.144 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168182677?api_key=51job×tamp=1768399405 status=200 resp_size=8307
|
||
2026-01-14 22:03:37.626 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399411&companyId=2213597&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13176
|
||
2026-01-14 22:03:47.057 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168144607?api_key=51job×tamp=1768399425 status=200 resp_size=5408
|
||
2026-01-14 22:03:47.388 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399427&companyId=2801734&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13439
|
||
2026-01-14 22:04:12.071 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800165?api_key=51job×tamp=1768399435 status=200 resp_size=5443
|
||
2026-01-14 22:04:16.212 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399452&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:04:20.530 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job×tamp=1768399457 status=200 resp_size=7193
|
||
2026-01-14 22:04:23.633 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399460&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
|
||
2026-01-14 22:04:29.412 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job×tamp=1768399464 status=200 resp_size=6080
|
||
2026-01-14 22:04:33.882 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399469&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
|
||
2026-01-14 22:04:41.597 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job×tamp=1768399477 status=200 resp_size=4916
|
||
2026-01-14 22:04:44.213 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399481&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
|
||
2026-01-14 22:05:01.548 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job×tamp=1768399491 status=200 resp_size=6166
|
||
2026-01-14 22:05:04.800 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399501&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:05:10.154 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job×tamp=1768399507 status=200 resp_size=6083
|
||
2026-01-14 22:05:12.536 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399510&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
|
||
2026-01-14 22:05:18.226 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job×tamp=1768399516 status=200 resp_size=6512
|
||
2026-01-14 22:05:19.464 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399518&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3039
|
||
2026-01-14 22:05:26.495 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job×tamp=1768399523 status=200 resp_size=6244
|
||
2026-01-14 22:05:31.240 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399526&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
|
||
2026-01-14 22:06:28.434 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job×tamp=1768399539 status=200 resp_size=6076
|
||
2026-01-14 22:06:39.390 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399588&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:06:51.162 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job×tamp=1768399603 status=200 resp_size=5691
|
||
2026-01-14 22:06:59.110 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399611&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
|
||
2026-01-14 22:07:08.523 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170170970?api_key=51job×tamp=1768399620 status=200 resp_size=5597
|
||
2026-01-14 22:07:15.600 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399628&companyId=2335084&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6333
|
||
2026-01-14 22:07:23.764 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job×tamp=1768399636 status=200 resp_size=6193
|
||
2026-01-14 22:07:31.883 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399643&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
|
||
2026-01-14 22:07:31.888 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 10 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 22:07:37.261 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 22:07:37.262 | INFO | __main__:crawl_multiple_pages:1033 - 第 10 页获取到 20 个职位 | 累计: 200 个
|
||
2026-01-14 22:07:39.102 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 1.84 秒后继续...
|
||
2026-01-14 22:07:39.102 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 11/26 页...
|
||
2026-01-14 22:07:39.103 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 22:07:39.118 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=11, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 22:07:39.766 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:07:40.923 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:07:43.055 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:07:43.055 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 22:07:43.491 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768399659 status=200 resp_size=139947
|
||
2026-01-14 22:07:43.491 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 11 页 jobIds 预览: ['170110379', '163371428', '169609507', '169984603', '169783777']
|
||
2026-01-14 22:07:43.492 | INFO | __main__:get_recommend_jobs:749 - 第 11 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 506 (原始值: 506) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 22:07:43.663 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job×tamp=1768399663 status=200 resp_size=5766
|
||
2026-01-14 22:07:43.851 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399663&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
|
||
2026-01-14 22:08:08.755 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job×tamp=1768399669 status=200 resp_size=6552
|
||
2026-01-14 22:08:12.777 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399688&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 22:08:19.256 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job×tamp=1768399698 status=200 resp_size=5876
|
||
2026-01-14 22:08:19.557 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399699&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13647
|
||
2026-01-14 22:08:29.936 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job×tamp=1768399709 status=200 resp_size=8622
|
||
2026-01-14 22:08:30.100 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399709&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14619
|
||
2026-01-14 22:08:53.760 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job×tamp=1768399718 status=200 resp_size=8728
|
||
2026-01-14 22:08:58.442 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399733&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
|
||
2026-01-14 22:09:05.062 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job×tamp=1768399744 status=200 resp_size=6017
|
||
2026-01-14 22:09:05.308 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399745&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
|
||
2026-01-14 22:09:12.837 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/100340868?api_key=51job×tamp=1768399751 status=200 resp_size=7941
|
||
2026-01-14 22:09:13.075 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399752&companyId=3906516&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9706
|
||
2026-01-14 22:09:22.904 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167399253?api_key=51job×tamp=1768399762 status=200 resp_size=7699
|
||
2026-01-14 22:09:23.150 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399762&companyId=3808633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6814
|
||
2026-01-14 22:09:26.263 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job×tamp=1768399766 status=200 resp_size=5286
|
||
2026-01-14 22:09:26.509 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399766&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
|
||
2026-01-14 22:09:32.469 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169929449?api_key=51job×tamp=1768399771 status=200 resp_size=6680
|
||
2026-01-14 22:09:32.640 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399772&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
|
||
2026-01-14 22:09:39.699 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job×tamp=1768399779 status=200 resp_size=5398
|
||
2026-01-14 22:09:39.899 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399779&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
|
||
2026-01-14 22:09:41.097 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/77739704?api_key=51job×tamp=1768399780 status=200 resp_size=6647
|
||
2026-01-14 22:09:41.284 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399781&companyId=2000037&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8643
|
||
2026-01-14 22:09:42.658 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job×tamp=1768399782 status=200 resp_size=5289
|
||
2026-01-14 22:09:42.837 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399782&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
|
||
2026-01-14 22:09:55.810 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job×tamp=1768399788 status=200 resp_size=6296
|
||
2026-01-14 22:09:57.826 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399795&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
|
||
2026-01-14 22:10:08.125 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job×tamp=1768399805 status=200 resp_size=5924
|
||
2026-01-14 22:10:08.896 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399808&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
|
||
2026-01-14 22:10:18.140 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job×tamp=1768399815 status=200 resp_size=6021
|
||
2026-01-14 22:10:18.747 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399818&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
|
||
2026-01-14 22:10:21.951 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job×tamp=1768399820 status=200 resp_size=5396
|
||
2026-01-14 22:10:23.188 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399821&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
|
||
2026-01-14 22:10:30.024 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job×tamp=1768399829 status=200 resp_size=5082
|
||
2026-01-14 22:10:30.165 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399830&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
|
||
2026-01-14 22:10:32.846 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573465?api_key=51job×tamp=1768399832 status=200 resp_size=13294
|
||
2026-01-14 22:10:33.043 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399832&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
|
||
2026-01-14 22:10:40.375 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job×tamp=1768399839 status=200 resp_size=5728
|
||
2026-01-14 22:10:40.645 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399840&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
|
||
2026-01-14 22:10:40.646 | INFO | __main__:get_recommend_jobs:800 - 准备上报第 11 页数据，包含详细信息的数据条数: 20
|
||
2026-01-14 22:10:40.746 | INFO | __main__:report_data:266 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
|
||
2026-01-14 22:10:40.747 | INFO | __main__:crawl_multiple_pages:1033 - 第 11 页获取到 20 个职位 | 累计: 220 个
|
||
2026-01-14 22:10:50.316 | INFO | __main__:crawl_multiple_pages:1047 - 休眠 9.56 秒后继续...
|
||
2026-01-14 22:10:50.317 | INFO | __main__:crawl_multiple_pages:1007 -
|
||
>>> 正在爬取第 12/26 页...
|
||
2026-01-14 22:10:50.317 | INFO | __main__:_init_client:414 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
|
||
2026-01-14 22:10:50.340 | INFO | __main__:get_recommend_jobs:657 - 获取推荐职位: 页码=12, 页大小=20, 地区=蚌埠, 工作类型=1108
|
||
2026-01-14 22:10:51.056 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:10:52.227 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:10:54.406 | WARNING | __main__:_make_request:617 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
|
||
2026-01-14 22:10:54.406 | ERROR | __main__:_make_request:643 - 所有重试失败，请求终止
|
||
2026-01-14 22:10:54.907 | INFO | __main__:_make_request:614 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job×tamp=1768399850 status=200 resp_size=121513
|
||
2026-01-14 22:10:54.907 | INFO | __main__:get_recommend_jobs:731 - 🔍 第 12 页 jobIds 预览: ['170224486', '167900472', '158021791', '170050278', '169117047']
|
||
2026-01-14 22:10:54.907 | INFO | __main__:get_recommend_jobs:749 - 第 12 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 506 (原始值: 506) | 地区: 蚌埠(蚌埠) | 职能: 知识产权/专利/商标(1108)
|
||
2026-01-14 22:10:55.117 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224486?api_key=51job×tamp=1768399854 status=200 resp_size=6059
|
||
2026-01-14 22:10:55.359 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399855&companyId=3779059&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7441
|
||
2026-01-14 22:10:59.963 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job×tamp=1768399859 status=200 resp_size=5280
|
||
2026-01-14 22:11:00.172 | INFO | __main__:_make_request:614 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job×tamp=1768399859&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
|