zfc/JobData
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
JobData/jobs_spider/qcwy/logs/log_2026-01-12.log

3581 lines
727 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-01-12 21:03:47.824 | INFO | __main__:crawl_recommend_jobs_main:1169 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.863 | INFO | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.905 | INFO | __main__:crawl_recommend_jobs_main:1197 - 随机选择城市: 宁德 (110900)
2026-01-12 21:03:47.906 | INFO | __main__:crawl_recommend_jobs_main:1201 - 随机选择工作类型: 产品VP (8802)
2026-01-12 21:03:47.906 | INFO | __main__:crawl_recommend_jobs_main:1203 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:03:47.906 | INFO | __main__:crawl_multiple_pages:999 - ================================================================================
2026-01-12 21:03:47.906 | INFO | __main__:crawl_multiple_pages:1000 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 宁德(110900) | 职能: 产品VP(8802)
2026-01-12 21:03:47.906 | INFO | __main__:crawl_multiple_pages:1001 - ================================================================================
2026-01-12 21:03:47.906 | INFO | __main__:crawl_multiple_pages:1004 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:03:47.906 | INFO | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.920 | INFO | __main__:get_recommend_jobs:658 - 获取推荐职位: 页码=1, 页大小=20, 地区=110900, 工作类型=8802
2026-01-12 21:03:50.622 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:51.962 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:54.294 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:54.294 | ERROR | __main__:_make_request:644 - 所有重试失败，请求终止
2026-01-12 21:03:55.106 | INFO | __main__:_make_request:615 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223027 status=200 resp_size=102688
2026-01-12 21:03:55.107 | INFO | __main__:get_recommend_jobs:746 - 第 1 页成功获取 19 个职位（去重后: 19） | API返回totalCount: 19 (原始值: 19) | 地区: 宁德(110900) | 职能: 产品VP(8802)
2026-01-12 21:03:55.803 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207797?api_key=51job&timestamp=1768223035 status=200 resp_size=4571
2026-01-12 21:03:56.340 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223035&companyId=10147208&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2775
2026-01-12 21:04:03.776 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162268166?api_key=51job&timestamp=1768223042 status=200 resp_size=5155
2026-01-12 21:04:04.296 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223043&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:04:08.832 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160028248?api_key=51job&timestamp=1768223048 status=200 resp_size=5702
2026-01-12 21:04:09.138 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223048&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:04:14.608 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163176884?api_key=51job&timestamp=1768223053 status=200 resp_size=4846
2026-01-12 21:04:14.990 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223054&companyId=9387161&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2586
2026-01-12 21:04:25.179 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169131017?api_key=51job&timestamp=1768223063 status=200 resp_size=5571
2026-01-12 21:04:25.504 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223065&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:04:28.653 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211074?api_key=51job&timestamp=1768223068 status=200 resp_size=5732
2026-01-12 21:04:28.883 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223068&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:04:37.694 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631979?api_key=51job&timestamp=1768223076 status=200 resp_size=5727
2026-01-12 21:04:37.964 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223077&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:04:45.473 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169963090?api_key=51job&timestamp=1768223084 status=200 resp_size=6346
2026-01-12 21:04:45.963 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223085&companyId=10123807&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-12 21:04:53.551 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168055185?api_key=51job&timestamp=1768223092 status=200 resp_size=6193
2026-01-12 21:04:53.801 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223093&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-12 21:04:57.062 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167177837?api_key=51job&timestamp=1768223096 status=200 resp_size=5621
2026-01-12 21:04:57.431 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223097&companyId=9872690&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5235
2026-01-12 21:05:08.302 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203701?api_key=51job&timestamp=1768223107 status=200 resp_size=5842
2026-01-12 21:05:09.344 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223108&companyId=10080902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2578
2026-01-12 21:05:18.689 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161538185?api_key=51job&timestamp=1768223117 status=200 resp_size=6352
2026-01-12 21:05:18.984 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223118&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:05:25.831 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170078237?api_key=51job&timestamp=1768223125 status=200 resp_size=5880
2026-01-12 21:05:26.035 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223125&companyId=10128402&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2626
2026-01-12 21:05:34.645 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167439224?api_key=51job&timestamp=1768223134 status=200 resp_size=6086
2026-01-12 21:05:34.819 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223134&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:05:42.764 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086123?api_key=51job&timestamp=1768223141 status=200 resp_size=5330
2026-01-12 21:05:42.985 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223142&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:05:47.866 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134662?api_key=51job&timestamp=1768223147 status=200 resp_size=6400
2026-01-12 21:05:48.114 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223147&companyId=10139385&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2687
2026-01-12 21:05:53.491 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169819268?api_key=51job&timestamp=1768223153 status=200 resp_size=5477
2026-01-12 21:05:56.801 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223153&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:05:59.025 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170051530?api_key=51job&timestamp=1768223158 status=200 resp_size=5134
2026-01-12 21:05:59.316 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223159&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 21:06:08.265 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169143272?api_key=51job&timestamp=1768223165 status=200 resp_size=6625
2026-01-12 21:06:08.574 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223168&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:06:08.574 | INFO | __main__:get_recommend_jobs:797 - 准备上报第 1 页数据，包含详细信息的数据条数: 19
2026-01-12 21:06:08.613 | INFO | __main__:report_data:267 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 21:06:08.613 | INFO | __main__:crawl_multiple_pages:1026 - 检测到API返回totalCount: 19 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:06:08.613 | INFO | __main__:crawl_multiple_pages:1030 - 第 1 页获取到 19 个职位 | 累计: 19 个
2026-01-12 21:06:08.613 | INFO | __main__:crawl_multiple_pages:1038 - 已获取所有数据 (19/19)，提前结束爬取
2026-01-12 21:06:08.613 | INFO | __main__:crawl_multiple_pages:1055 -
================================================================================
2026-01-12 21:06:08.613 | INFO | __main__:crawl_multiple_pages:1056 - 爬取统计信息:
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1057 - 总抓取数量: 19 条
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1058 - 去重后数量: 19 条
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1059 - 重复数量: 0 条
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1060 - API返回totalCount: 19 条
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1061 - 实际爬取页数: 1 页
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1062 - 地区: 宁德(110900)
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1063 - 职能: 产品VP(8802)
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1066 - 覆盖率: 100.00% (19/19)
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1071 - ================================================================================
2026-01-12 21:06:08.614 | INFO | __main__:save_crawl_stats:130 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:06:08.614 | INFO | __main__:crawl_multiple_pages:1085 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 19 条记录)
2026-01-12 21:06:08.616 | INFO | __main__:crawl_recommend_jobs_main:1215 - 推荐职位爬取完成！共找到 19 个职位
2026-01-12 21:06:08.616 | INFO | __main__:close:1136 - httpx客户端已关闭
2026-01-12 21:06:16.938 | INFO | __main__:crawl_recommend_jobs_main:1169 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.951 | INFO | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.979 | INFO | __main__:crawl_recommend_jobs_main:1197 - 随机选择城市: 怀化 (191100)
2026-01-12 21:06:16.979 | INFO | __main__:crawl_recommend_jobs_main:1201 - 随机选择工作类型: 水工 (3709)
2026-01-12 21:06:16.980 | INFO | __main__:crawl_recommend_jobs_main:1203 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:06:16.980 | INFO | __main__:crawl_multiple_pages:999 - ================================================================================
2026-01-12 21:06:16.980 | INFO | __main__:crawl_multiple_pages:1000 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 怀化(191100) | 职能: 水工(3709)
2026-01-12 21:06:16.980 | INFO | __main__:crawl_multiple_pages:1001 - ================================================================================
2026-01-12 21:06:16.980 | INFO | __main__:crawl_multiple_pages:1004 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:06:16.980 | INFO | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.992 | INFO | __main__:get_recommend_jobs:658 - 获取推荐职位: 页码=1, 页大小=20, 地区=191100, 工作类型=3709
2026-01-12 21:06:19.043 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:20.339 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:22.619 | WARNING | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:22.619 | ERROR | __main__:_make_request:644 - 所有重试失败，请求终止
2026-01-12 21:06:23.298 | INFO | __main__:_make_request:615 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223176 status=200 resp_size=104016
2026-01-12 21:06:23.298 | INFO | __main__:get_recommend_jobs:746 - 第 1 页成功获取 18 个职位（去重后: 18） | API返回totalCount: 18 (原始值: 18) | 地区: 怀化(191100) | 职能: 水工(3709)
2026-01-12 21:06:23.669 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168121261?api_key=51job&timestamp=1768223183 status=200 resp_size=6064
2026-01-12 21:06:23.941 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223183&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:06:29.987 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269314?api_key=51job&timestamp=1768223189 status=200 resp_size=6959
2026-01-12 21:06:30.176 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223189&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:06:34.335 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526878?api_key=51job&timestamp=1768223194 status=200 resp_size=5515
2026-01-12 21:06:34.523 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223194&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:06:44.315 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162204848?api_key=51job&timestamp=1768223203 status=200 resp_size=5676
2026-01-12 21:06:45.724 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223204&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:06:58.836 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170162517?api_key=51job&timestamp=1768223214 status=200 resp_size=5288
2026-01-12 21:07:00.383 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223218&companyId=4206092&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6265
2026-01-12 21:07:10.882 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159994837?api_key=51job&timestamp=1768223229 status=200 resp_size=5873
2026-01-12 21:07:11.084 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223230&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:07:15.153 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170011953?api_key=51job&timestamp=1768223234 status=200 resp_size=7612
2026-01-12 21:07:15.479 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223235&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:07:22.208 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170162215?api_key=51job&timestamp=1768223241 status=200 resp_size=5022
2026-01-12 21:07:22.534 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223242&companyId=4206092&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6265
2026-01-12 21:07:26.613 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188999?api_key=51job&timestamp=1768223246 status=200 resp_size=5531
2026-01-12 21:07:26.858 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223246&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:07:38.049 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168411165?api_key=51job&timestamp=1768223256 status=200 resp_size=7227
2026-01-12 21:07:38.275 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223258&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:07:44.662 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256770?api_key=51job&timestamp=1768223263 status=200 resp_size=6358
2026-01-12 21:07:45.051 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223264&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:07:54.763 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161588035?api_key=51job&timestamp=1768223273 status=200 resp_size=6359
2026-01-12 21:07:55.029 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223274&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:08:03.662 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168742494?api_key=51job&timestamp=1768223282 status=200 resp_size=6510
2026-01-12 21:08:03.930 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223283&companyId=9947213&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7021
2026-01-12 21:08:06.856 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168146233?api_key=51job&timestamp=1768223286 status=200 resp_size=6169
2026-01-12 21:08:07.215 | INFO | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223286&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 21:08:13.687 | INFO | __main__:crawl_recommend_jobs_main:1222 - 用户中断推荐职位爬取
2026-01-12 21:08:13.688 | INFO | __main__:close:1136 - httpx客户端已关闭
2026-01-12 21:11:48.859 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:48.969 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:59.032 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 拉萨 (300200)
2026-01-12 21:11:59.034 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 施工开料工 (2143)
2026-01-12 21:11:59.034 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:11:59.034 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:11:59.035 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 拉萨(300200) | 职能: 施工开料工(2143)
2026-01-12 21:11:59.035 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:11:59.036 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:11:59.036 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:59.056 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=300200, 工作类型=2143
2026-01-12 21:12:00.388 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:01.682 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:03.919 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:03.919 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:12:04.341 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223519 status=200 resp_size=65878
2026-01-12 21:12:04.343 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 12 个职位（去重后: 12） | API返回totalCount: 12 (原始值: 12) | 地区: 拉萨(300200) | 职能: 施工开料工(2143)
2026-01-12 21:12:04.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136608?api_key=51job&timestamp=1768223524 status=200 resp_size=4480
2026-01-12 21:12:04.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223524&companyId=10141099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2857
2026-01-12 21:12:13.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635818?api_key=51job&timestamp=1768223532 status=200 resp_size=6238
2026-01-12 21:12:13.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223533&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:12:16.007 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166120581?api_key=51job&timestamp=1768223535 status=200 resp_size=5609
2026-01-12 21:12:16.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223536&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:12:23.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163239608?api_key=51job&timestamp=1768223542 status=200 resp_size=4503
2026-01-12 21:12:23.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223543&companyId=9383822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2691
2026-01-12 21:12:25.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167459585?api_key=51job&timestamp=1768223545 status=200 resp_size=5629
2026-01-12 21:12:25.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223545&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:12:35.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163193190?api_key=51job&timestamp=1768223554 status=200 resp_size=6285
2026-01-12 21:12:35.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223555&companyId=9490549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2655
2026-01-12 21:12:38.806 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:12:38.806 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:12:40.891 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.937 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.970 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 济宁 (120900)
2026-01-12 21:12:40.970 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 前端开发 (A0JU)
2026-01-12 21:12:40.970 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:12:40.971 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:12:40.971 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 济宁(120900) | 职能: 前端开发(A0JU)
2026-01-12 21:12:40.971 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:12:40.971 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:12:40.971 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.984 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=120900, 工作类型=A0JU
2026-01-12 21:12:42.104 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:43.015 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:12:43.015 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:12:47.510 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.551 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.577 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 日照 (121200)
2026-01-12 21:12:47.578 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 建筑设计师 (6905)
2026-01-12 21:12:47.578 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:12:47.578 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:12:47.578 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 日照(121200) | 职能: 建筑设计师(6905)
2026-01-12 21:12:47.578 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:12:47.578 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:12:47.578 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.592 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=121200, 工作类型=6905
2026-01-12 21:12:48.546 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:49.808 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:52.011 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:52.012 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:12:52.489 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223567 status=200 resp_size=95121
2026-01-12 21:12:52.490 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 17 个职位（去重后: 17） | API返回totalCount: 17 (原始值: 17) | 地区: 日照(121200) | 职能: 建筑设计师(6905)
2026-01-12 21:12:52.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164335478?api_key=51job&timestamp=1768223572 status=200 resp_size=5642
2026-01-12 21:12:53.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223572&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:12:54.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269124?api_key=51job&timestamp=1768223574 status=200 resp_size=6981
2026-01-12 21:12:54.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223574&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:12:58.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166514313?api_key=51job&timestamp=1768223578 status=200 resp_size=5515
2026-01-12 21:12:58.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223578&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:13:05.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347759?api_key=51job&timestamp=1768223584 status=200 resp_size=5479
2026-01-12 21:13:05.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223585&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:13:08.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169680079?api_key=51job&timestamp=1768223587 status=200 resp_size=6040
2026-01-12 21:13:08.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223588&companyId=10096208&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3018
2026-01-12 21:13:15.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162100384?api_key=51job&timestamp=1768223594 status=200 resp_size=5396
2026-01-12 21:13:15.621 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223595&companyId=9390971&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2589
2026-01-12 21:13:27.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211080?api_key=51job&timestamp=1768223604 status=200 resp_size=5737
2026-01-12 21:13:27.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223607&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:13:33.082 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048113?api_key=51job&timestamp=1768223612 status=200 resp_size=6500
2026-01-12 21:13:33.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223613&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:13:42.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161664886?api_key=51job&timestamp=1768223621 status=200 resp_size=6351
2026-01-12 21:13:42.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223622&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:13:51.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167613542?api_key=51job&timestamp=1768223629 status=200 resp_size=6137
2026-01-12 21:13:51.403 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223631&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:13:55.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170045976?api_key=51job&timestamp=1768223634 status=200 resp_size=6068
2026-01-12 21:13:55.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223635&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-12 21:14:04.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376576?api_key=51job&timestamp=1768223643 status=200 resp_size=7232
2026-01-12 21:14:05.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223644&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:14:09.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169819741?api_key=51job&timestamp=1768223648 status=200 resp_size=5524
2026-01-12 21:14:09.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223649&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:14:18.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564012?api_key=51job&timestamp=1768223657 status=200 resp_size=5556
2026-01-12 21:14:19.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223658&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:14:29.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166084163?api_key=51job&timestamp=1768223668 status=200 resp_size=5509
2026-01-12 21:14:29.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223669&companyId=9788564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5265
2026-01-12 21:14:32.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063488?api_key=51job&timestamp=1768223672 status=200 resp_size=5199
2026-01-12 21:14:33.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223672&companyId=10133483&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3132
2026-01-12 21:14:36.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169354979?api_key=51job&timestamp=1768223675 status=200 resp_size=6623
2026-01-12 21:14:36.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223676&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:14:36.424 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 17
2026-01-12 21:14:36.472 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-12 21:14:36.472 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 17 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:14:36.472 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 17 个职位 | 累计: 17 个
2026-01-12 21:14:36.472 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (17/17)，提前结束爬取
2026-01-12 21:14:36.472 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:14:36.473 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:14:36.473 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 17 条
2026-01-12 21:14:36.473 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 17 条
2026-01-12 21:14:36.473 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:14:36.473 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 17 条
2026-01-12 21:14:36.474 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 1 页
2026-01-12 21:14:36.474 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 日照(121200)
2026-01-12 21:14:36.474 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 建筑设计师(6905)
2026-01-12 21:14:36.474 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (17/17)
2026-01-12 21:14:36.474 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:14:36.475 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:14:36.475 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 17 条记录)
2026-01-12 21:14:36.475 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 17 个职位
2026-01-12 21:14:36.475 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:14:45.934 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.947 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.978 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 丹东 (230800)
2026-01-12 21:14:45.978 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 业务拓展经理/主管 (0232)
2026-01-12 21:14:45.978 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:14:45.978 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:14:45.979 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 丹东(230800) | 职能: 业务拓展经理/主管(0232)
2026-01-12 21:14:45.979 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:14:45.979 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:14:45.979 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.990 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=230800, 工作类型=0232
2026-01-12 21:14:46.653 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:47.799 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:49.937 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:49.937 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:14:50.249 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223685 status=200 resp_size=64748
2026-01-12 21:14:50.250 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 12 个职位（去重后: 12） | API返回totalCount: 12 (原始值: 12) | 地区: 丹东(230800) | 职能: 业务拓展经理/主管(0232)
2026-01-12 21:14:50.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170085916?api_key=51job&timestamp=1768223690 status=200 resp_size=5351
2026-01-12 21:14:50.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223690&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:14:55.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162439445?api_key=51job&timestamp=1768223695 status=200 resp_size=5591
2026-01-12 21:14:55.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223695&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:15:06.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526953?api_key=51job&timestamp=1768223704 status=200 resp_size=5515
2026-01-12 21:15:07.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223706&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:15:15.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160061497?api_key=51job&timestamp=1768223714 status=200 resp_size=6058
2026-01-12 21:15:15.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223715&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:15:19.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169236588?api_key=51job&timestamp=1768223718 status=200 resp_size=5653
2026-01-12 21:15:19.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223719&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:15:30.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269401?api_key=51job&timestamp=1768223728 status=200 resp_size=6979
2026-01-12 21:15:30.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223730&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:15:35.622 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168413335?api_key=51job&timestamp=1768223734 status=200 resp_size=7227
2026-01-12 21:15:36.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223735&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:15:46.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256140?api_key=51job&timestamp=1768223745 status=200 resp_size=6086
2026-01-12 21:15:46.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223746&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 21:15:54.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161633240?api_key=51job&timestamp=1768223753 status=200 resp_size=6347
2026-01-12 21:15:54.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223754&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:15:57.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170228247?api_key=51job&timestamp=1768223757 status=200 resp_size=6581
2026-01-12 21:15:57.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223757&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:16:07.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169947494?api_key=51job&timestamp=1768223766 status=200 resp_size=4432
2026-01-12 21:16:07.873 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223767&companyId=10122481&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2992
2026-01-12 21:16:16.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873457?api_key=51job&timestamp=1768223775 status=200 resp_size=4345
2026-01-12 21:16:16.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223776&companyId=10114808&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:16:16.594 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 12
2026-01-12 21:16:16.640 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 12, 响应大小: 113 字节
2026-01-12 21:16:16.641 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 12 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:16:16.641 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 12 个职位 | 累计: 12 个
2026-01-12 21:16:16.641 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (12/12)，提前结束爬取
2026-01-12 21:16:16.642 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:16:16.642 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:16:16.642 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 12 条
2026-01-12 21:16:16.642 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 12 条
2026-01-12 21:16:16.642 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 12 条
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 1 页
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 丹东(230800)
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 业务拓展经理/主管(0232)
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (12/12)
2026-01-12 21:16:16.643 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:16:16.644 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:16:16.645 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 12 条记录)
2026-01-12 21:16:16.645 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 12 个职位
2026-01-12 21:16:16.645 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:16:17.696 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.706 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.727 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 大连 (230300)
2026-01-12 21:16:17.728 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 挡车工 (3825)
2026-01-12 21:16:17.728 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:16:17.729 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:16:17.729 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:16:17.729 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:16:17.729 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:16:17.729 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.741 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:16:19.879 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:21.091 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:23.300 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:23.300 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:16:24.109 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223777 status=200 resp_size=107661
2026-01-12 21:16:24.109 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:16:24.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691224?api_key=51job&timestamp=1768223784 status=200 resp_size=7222
2026-01-12 21:16:24.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223784&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 21:16:32.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269404?api_key=51job&timestamp=1768223791 status=200 resp_size=7001
2026-01-12 21:16:32.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223792&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:16:39.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371882?api_key=51job&timestamp=1768223798 status=200 resp_size=5240
2026-01-12 21:16:39.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223799&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:16:46.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160372430?api_key=51job&timestamp=1768223805 status=200 resp_size=5645
2026-01-12 21:16:46.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223806&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:16:50.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134816?api_key=51job&timestamp=1768223810 status=200 resp_size=4887
2026-01-12 21:16:51.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223810&companyId=10140823&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3057
2026-01-12 21:16:54.940 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370360?api_key=51job&timestamp=1768223814 status=200 resp_size=5552
2026-01-12 21:16:55.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223814&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:17:05.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163667206?api_key=51job&timestamp=1768223820 status=200 resp_size=5084
2026-01-12 21:17:05.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223825&companyId=9431870&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2605
2026-01-12 21:17:08.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164791637?api_key=51job&timestamp=1768223827 status=200 resp_size=6265
2026-01-12 21:17:09.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223828&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:17:14.619 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161633211?api_key=51job&timestamp=1768223833 status=200 resp_size=6370
2026-01-12 21:17:15.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223834&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:17:27.416 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370120?api_key=51job&timestamp=1768223844 status=200 resp_size=5619
2026-01-12 21:17:28.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223847&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:17:32.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165020146?api_key=51job&timestamp=1768223851 status=200 resp_size=6026
2026-01-12 21:17:32.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223852&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:17:39.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167426160?api_key=51job&timestamp=1768223858 status=200 resp_size=5522
2026-01-12 21:17:40.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223859&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 21:17:49.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126795?api_key=51job&timestamp=1768223867 status=200 resp_size=6292
2026-01-12 21:17:49.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223869&companyId=10139549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2868
2026-01-12 21:17:58.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160081733?api_key=51job&timestamp=1768223877 status=200 resp_size=6127
2026-01-12 21:17:58.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223878&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:18:01.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526989?api_key=51job&timestamp=1768223881 status=200 resp_size=5515
2026-01-12 21:18:02.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223881&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:18:09.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370416?api_key=51job&timestamp=1768223888 status=200 resp_size=5730
2026-01-12 21:18:09.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223889&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:18:17.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170107374?api_key=51job&timestamp=1768223896 status=200 resp_size=5788
2026-01-12 21:18:19.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223897&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:18:29.538 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157485381?api_key=51job&timestamp=1768223907 status=200 resp_size=5712
2026-01-12 21:18:29.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223909&companyId=8975951&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2671
2026-01-12 21:18:39.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154190333?api_key=51job&timestamp=1768223918 status=200 resp_size=4682
2026-01-12 21:18:39.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223919&companyId=8090601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2701
2026-01-12 21:18:41.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166382946?api_key=51job&timestamp=1768223920 status=200 resp_size=6251
2026-01-12 21:18:41.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223921&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:18:41.290 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:18:41.342 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:18:41.342 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 184 | 计算需要爬取: 10 页 (每页 20 条) | 预计最大数据: 200 条
2026-01-12 21:18:41.342 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:18:48.004 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.66 秒后继续...
2026-01-12 21:18:48.004 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/10 页...
2026-01-12 21:18:48.005 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:18:48.026 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:18:49.013 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:50.250 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:52.486 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:52.488 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:18:53.036 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223928 status=200 resp_size=111868
2026-01-12 21:18:53.036 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:18:54.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167284969?api_key=51job&timestamp=1768223933 status=200 resp_size=6600
2026-01-12 21:18:54.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223934&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:19:02.815 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164840538?api_key=51job&timestamp=1768223941 status=200 resp_size=6356
2026-01-12 21:19:03.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223942&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:19:07.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163859822?api_key=51job&timestamp=1768223947 status=200 resp_size=6117
2026-01-12 21:19:07.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223947&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:19:10.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179466?api_key=51job&timestamp=1768223949 status=200 resp_size=5613
2026-01-12 21:19:10.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223950&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:19:19.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134039?api_key=51job&timestamp=1768223957 status=200 resp_size=6951
2026-01-12 21:19:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223959&companyId=3090589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6574
2026-01-12 21:19:27.496 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166913879?api_key=51job&timestamp=1768223965 status=200 resp_size=5156
2026-01-12 21:19:27.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223967&companyId=9496587&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2726
2026-01-12 21:19:31.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162791900?api_key=51job&timestamp=1768223971 status=200 resp_size=5095
2026-01-12 21:19:32.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223971&companyId=9442657&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2602
2026-01-12 21:19:40.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954413?api_key=51job&timestamp=1768223978 status=200 resp_size=5930
2026-01-12 21:19:40.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223980&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:19:45.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165491987?api_key=51job&timestamp=1768223985 status=200 resp_size=6129
2026-01-12 21:19:45.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223985&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:19:54.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166116057?api_key=51job&timestamp=1768223993 status=200 resp_size=6206
2026-01-12 21:19:54.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223994&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:20:04.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165619180?api_key=51job&timestamp=1768224003 status=200 resp_size=6240
2026-01-12 21:20:04.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224004&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:20:14.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161789556?api_key=51job&timestamp=1768224013 status=200 resp_size=5206
2026-01-12 21:20:14.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224014&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 21:20:22.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168263818?api_key=51job&timestamp=1768224021 status=200 resp_size=5648
2026-01-12 21:20:22.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224022&companyId=9730476&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:20:27.627 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041140?api_key=51job&timestamp=1768224027 status=200 resp_size=5806
2026-01-12 21:20:27.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224027&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:20:37.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165893672?api_key=51job&timestamp=1768224036 status=200 resp_size=5370
2026-01-12 21:20:39.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224037&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:20:43.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164110649?api_key=51job&timestamp=1768224043 status=200 resp_size=5428
2026-01-12 21:20:43.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224043&companyId=9548336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4229
2026-01-12 21:20:55.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166956190?api_key=51job&timestamp=1768224053 status=200 resp_size=13621
2026-01-12 21:20:55.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224055&companyId=4313557&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6990
2026-01-12 21:21:04.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160490611?api_key=51job&timestamp=1768224063 status=200 resp_size=5031
2026-01-12 21:21:04.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224064&companyId=9247001&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2620
2026-01-12 21:21:06.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954599?api_key=51job&timestamp=1768224066 status=200 resp_size=5642
2026-01-12 21:21:06.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224066&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:21:09.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165192496?api_key=51job&timestamp=1768224069 status=200 resp_size=6318
2026-01-12 21:21:09.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224069&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:21:09.613 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:21:18.613 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:21:18.614 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:21:26.968 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.35 秒后继续...
2026-01-12 21:21:26.968 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/10 页...
2026-01-12 21:21:26.968 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:21:27.000 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:21:28.704 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:29.883 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:32.075 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:32.075 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:21:32.557 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224087 status=200 resp_size=116432
2026-01-12 21:21:32.558 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:21:32.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138250877?api_key=51job&timestamp=1768224092 status=200 resp_size=5184
2026-01-12 21:21:33.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224092&companyId=2335820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8291
2026-01-12 21:21:42.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166633851?api_key=51job&timestamp=1768224101 status=200 resp_size=4918
2026-01-12 21:21:42.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224102&companyId=9442657&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2602
2026-01-12 21:21:52.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078573?api_key=51job&timestamp=1768224111 status=200 resp_size=5609
2026-01-12 21:21:52.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224112&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:21:54.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165124965?api_key=51job&timestamp=1768224114 status=200 resp_size=5278
2026-01-12 21:21:55.086 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224114&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:22:03.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170049037?api_key=51job&timestamp=1768224122 status=200 resp_size=6653
2026-01-12 21:22:03.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224123&companyId=9882618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3684
2026-01-12 21:22:14.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163718469?api_key=51job&timestamp=1768224132 status=200 resp_size=5618
2026-01-12 21:22:15.071 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224134&companyId=9539124&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4639
2026-01-12 21:22:25.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165124664?api_key=51job&timestamp=1768224144 status=200 resp_size=5257
2026-01-12 21:22:25.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224145&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:22:34.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166506615?api_key=51job&timestamp=1768224154 status=200 resp_size=6192
2026-01-12 21:22:35.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224154&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:22:37.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169906447?api_key=51job&timestamp=1768224157 status=200 resp_size=5708
2026-01-12 21:22:37.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224157&companyId=7983970&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5833
2026-01-12 21:22:42.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631944?api_key=51job&timestamp=1768224162 status=200 resp_size=5731
2026-01-12 21:22:42.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224162&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:22:54.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635779?api_key=51job&timestamp=1768224172 status=200 resp_size=6209
2026-01-12 21:22:54.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224174&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:23:03.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166033124?api_key=51job&timestamp=1768224182 status=200 resp_size=5940
2026-01-12 21:23:04.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224183&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:09.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168817188?api_key=51job&timestamp=1768224188 status=200 resp_size=13664
2026-01-12 21:23:10.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224189&companyId=4313557&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6990
2026-01-12 21:23:21.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080629?api_key=51job&timestamp=1768224200 status=200 resp_size=5637
2026-01-12 21:23:21.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224201&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:26.970 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138199?api_key=51job&timestamp=1768224206 status=200 resp_size=5790
2026-01-12 21:23:27.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224206&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:37.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167326605?api_key=51job&timestamp=1768224216 status=200 resp_size=5874
2026-01-12 21:23:37.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224217&companyId=8826736&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2889
2026-01-12 21:23:48.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164902924?api_key=51job&timestamp=1768224227 status=200 resp_size=5585
2026-01-12 21:23:49.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224228&companyId=9685568&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3240
2026-01-12 21:23:58.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164763117?api_key=51job&timestamp=1768224237 status=200 resp_size=6975
2026-01-12 21:23:58.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224238&companyId=9501936&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7850
2026-01-12 21:24:06.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/136921478?api_key=51job&timestamp=1768224244 status=200 resp_size=3473
2026-01-12 21:24:06.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224246&companyId=6851156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2184
2026-01-12 21:24:08.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169972059?api_key=51job&timestamp=1768224248 status=200 resp_size=6005
2026-01-12 21:24:08.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224248&companyId=4499506&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4889
2026-01-12 21:24:08.938 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:24:08.977 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:24:08.977 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:24:15.831 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.85 秒后继续...
2026-01-12 21:24:15.831 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/10 页...
2026-01-12 21:24:15.831 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:24:15.863 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:24:17.055 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:18.321 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:20.616 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:20.621 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:24:21.348 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224255 status=200 resp_size=121825
2026-01-12 21:24:21.351 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:24:21.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163228668?api_key=51job&timestamp=1768224261 status=200 resp_size=7209
2026-01-12 21:24:21.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224261&companyId=9501936&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7850
2026-01-12 21:24:24.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170190047?api_key=51job&timestamp=1768224263 status=200 resp_size=4374
2026-01-12 21:24:24.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224264&companyId=10145619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2816
2026-01-12 21:24:28.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160552029?api_key=51job&timestamp=1768224268 status=200 resp_size=7209
2026-01-12 21:24:28.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224268&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 21:24:35.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169314323?api_key=51job&timestamp=1768224274 status=200 resp_size=7405
2026-01-12 21:24:36.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224275&companyId=7798467&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6611
2026-01-12 21:24:42.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/145686870?api_key=51job&timestamp=1768224281 status=200 resp_size=7329
2026-01-12 21:24:42.702 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224282&companyId=309838&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12739
2026-01-12 21:24:46.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167692343?api_key=51job&timestamp=1768224286 status=200 resp_size=4975
2026-01-12 21:24:46.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224286&companyId=2674810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5239
2026-01-12 21:24:54.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166616534?api_key=51job&timestamp=1768224294 status=200 resp_size=5877
2026-01-12 21:24:55.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224294&companyId=9827030&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2579
2026-01-12 21:24:57.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168414575?api_key=51job&timestamp=1768224296 status=200 resp_size=6850
2026-01-12 21:24:57.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224297&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:25:21.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168649917?api_key=51job&timestamp=1768224307 status=200 resp_size=5254
2026-01-12 21:25:24.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224321&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 21:25:30.832 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166606993?api_key=51job&timestamp=1768224328 status=200 resp_size=5440
2026-01-12 21:25:32.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224330&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:25:42.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170009624?api_key=51job&timestamp=1768224341 status=200 resp_size=4774
2026-01-12 21:25:42.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224342&companyId=10087570&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3328
2026-01-12 21:25:45.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208618?api_key=51job&timestamp=1768224345 status=200 resp_size=4737
2026-01-12 21:25:46.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224345&companyId=10088749&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3418
2026-01-12 21:25:51.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168566307?api_key=51job&timestamp=1768224351 status=200 resp_size=5424
2026-01-12 21:25:51.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224351&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 21:26:01.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168912761?api_key=51job&timestamp=1768224359 status=200 resp_size=6122
2026-01-12 21:26:01.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224361&companyId=9882618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3684
2026-01-12 21:26:03.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168352270?api_key=51job&timestamp=1768224363 status=200 resp_size=5896
2026-01-12 21:26:03.722 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224363&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 21:26:07.196 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766665?api_key=51job&timestamp=1768224366 status=200 resp_size=4911
2026-01-12 21:26:07.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224367&companyId=10089231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3418
2026-01-12 21:26:11.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165492185?api_key=51job&timestamp=1768224371 status=200 resp_size=6813
2026-01-12 21:26:13.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224371&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:26:14.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169286538?api_key=51job&timestamp=1768224374 status=200 resp_size=7511
2026-01-12 21:26:15.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224374&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:26:24.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168329370?api_key=51job&timestamp=1768224381 status=200 resp_size=4918
2026-01-12 21:26:25.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224384&companyId=9945478&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3473
2026-01-12 21:26:29.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165492160?api_key=51job&timestamp=1768224388 status=200 resp_size=6641
2026-01-12 21:26:30.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224389&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:26:30.346 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 21:26:30.402 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:26:30.402 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 21:26:33.399 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.99 秒后继续...
2026-01-12 21:26:33.399 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/10 页...
2026-01-12 21:26:33.399 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:26:33.431 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:26:35.140 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:36.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:38.759 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:38.759 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:26:39.611 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224393 status=200 resp_size=127256
2026-01-12 21:26:39.611 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:26:39.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166838152?api_key=51job&timestamp=1768224399 status=200 resp_size=5079
2026-01-12 21:26:40.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224399&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:26:42.035 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:26:42.036 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:27:02.560 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.598 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.625 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 淮北 (151700)
2026-01-12 21:27:02.626 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 成本管理员 (0409)
2026-01-12 21:27:02.626 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:27:02.626 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:27:02.626 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 淮北(151700) | 职能: 成本管理员(0409)
2026-01-12 21:27:02.626 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:27:02.627 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:27:02.627 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.641 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=151700, 工作类型=0409
2026-01-12 21:27:04.216 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:05.460 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:07.710 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:07.710 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:27:08.091 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224422 status=200 resp_size=48609
2026-01-12 21:27:08.092 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 9 个职位（去重后: 9） | API返回totalCount: 9 (原始值: 9) | 地区: 淮北(151700) | 职能: 成本管理员(0409)
2026-01-12 21:27:08.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269226?api_key=51job&timestamp=1768224428 status=200 resp_size=6959
2026-01-12 21:27:08.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224428&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:27:14.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169745397?api_key=51job&timestamp=1768224433 status=200 resp_size=7168
2026-01-12 21:27:16.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224434&companyId=10016288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5913
2026-01-12 21:27:27.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159348196?api_key=51job&timestamp=1768224445 status=200 resp_size=5342
2026-01-12 21:27:27.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224447&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:27:30.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519483?api_key=51job&timestamp=1768224448 status=200 resp_size=5515
2026-01-12 21:27:30.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224450&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:27:41.237 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169802799?api_key=51job&timestamp=1768224460 status=200 resp_size=4716
2026-01-12 21:27:41.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224461&companyId=10107860&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2894
2026-01-12 21:27:50.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169575655?api_key=51job&timestamp=1768224469 status=200 resp_size=5553
2026-01-12 21:27:51.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224470&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:28:00.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168377007?api_key=51job&timestamp=1768224479 status=200 resp_size=7231
2026-01-12 21:28:00.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224480&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:28:04.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166835861?api_key=51job&timestamp=1768224484 status=200 resp_size=5789
2026-01-12 21:28:05.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224484&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:28:15.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563422?api_key=51job&timestamp=1768224494 status=200 resp_size=6177
2026-01-12 21:28:16.798 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224495&companyId=10086029&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2755
2026-01-12 21:28:16.798 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 9
2026-01-12 21:28:16.815 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 9, 响应大小: 112 字节
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 9 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 9 个职位 | 累计: 9 个
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (9/9)，提前结束爬取
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:28:16.815 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 9 条
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 9 条
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 9 条
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 1 页
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 淮北(151700)
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 成本管理员(0409)
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (9/9)
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:28:16.817 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:28:16.817 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 9 条记录)
2026-01-12 21:28:16.817 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 9 个职位
2026-01-12 21:28:16.817 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:28:21.585 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.615 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.686 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 兰州 (270200)
2026-01-12 21:28:21.686 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 岩土工程 (2119)
2026-01-12 21:28:21.686 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:28:21.687 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:28:21.687 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:28:21.687 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:28:21.687 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:28:21.687 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.704 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:28:24.322 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:25.709 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:28.069 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:28.070 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:28:28.809 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224501 status=200 resp_size=115793
2026-01-12 21:28:28.810 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:28:30.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161468043?api_key=51job&timestamp=1768224508 status=200 resp_size=5948
2026-01-12 21:28:30.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224510&companyId=1989258&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10558
2026-01-12 21:28:41.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163678320?api_key=51job&timestamp=1768224520 status=200 resp_size=5537
2026-01-12 21:28:41.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224521&companyId=8362922&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4417
2026-01-12 21:28:49.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269484?api_key=51job&timestamp=1768224528 status=200 resp_size=6981
2026-01-12 21:28:49.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224529&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:28:57.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164804615?api_key=51job&timestamp=1768224536 status=200 resp_size=5439
2026-01-12 21:28:57.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224537&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:29:01.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163473297?api_key=51job&timestamp=1768224541 status=200 resp_size=5593
2026-01-12 21:29:01.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224541&companyId=2660857&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7869
2026-01-12 21:29:06.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163859819?api_key=51job&timestamp=1768224546 status=200 resp_size=6117
2026-01-12 21:29:06.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224546&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:29:11.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165893370?api_key=51job&timestamp=1768224550 status=200 resp_size=5156
2026-01-12 21:29:11.662 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224551&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:29:14.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164170726?api_key=51job&timestamp=1768224553 status=200 resp_size=6078
2026-01-12 21:29:14.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224554&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:29:19.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068777?api_key=51job&timestamp=1768224559 status=200 resp_size=5943
2026-01-12 21:29:20.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224559&companyId=3981027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6956
2026-01-12 21:29:31.578 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165854340?api_key=51job&timestamp=1768224570 status=200 resp_size=5486
2026-01-12 21:29:31.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224571&companyId=9761172&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2550
2026-01-12 21:29:40.268 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166128304?api_key=51job&timestamp=1768224579 status=200 resp_size=5247
2026-01-12 21:29:40.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224580&companyId=9790233&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2836
2026-01-12 21:29:48.700 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163321960?api_key=51job&timestamp=1768224586 status=200 resp_size=6114
2026-01-12 21:29:48.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224588&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:29:59.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161468452?api_key=51job&timestamp=1768224598 status=200 resp_size=6673
2026-01-12 21:29:59.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224599&companyId=1989258&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10558
2026-01-12 21:30:10.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078587?api_key=51job&timestamp=1768224608 status=200 resp_size=5607
2026-01-12 21:30:10.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224610&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:30:16.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166454496?api_key=51job&timestamp=1768224614 status=200 resp_size=5768
2026-01-12 21:30:16.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224616&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:30:26.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041175?api_key=51job&timestamp=1768224625 status=200 resp_size=6161
2026-01-12 21:30:26.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224626&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:30:43.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163840656?api_key=51job&timestamp=1768224633 status=200 resp_size=5404
2026-01-12 21:30:44.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224643&companyId=7108962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3047
2026-01-12 21:30:56.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163193188?api_key=51job&timestamp=1768224654 status=200 resp_size=6294
2026-01-12 21:30:56.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224656&companyId=9490549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2655
2026-01-12 21:31:04.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157485396?api_key=51job&timestamp=1768224663 status=200 resp_size=5712
2026-01-12 21:31:04.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224664&companyId=8975951&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2671
2026-01-12 21:31:07.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370431?api_key=51job&timestamp=1768224667 status=200 resp_size=5738
2026-01-12 21:31:08.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224667&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:31:08.161 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:31:08.220 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:31:08.220 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 102 | 计算需要爬取: 6 页 (每页 20 条) | 预计最大数据: 120 条
2026-01-12 21:31:08.220 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:31:12.089 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.87 秒后继续...
2026-01-12 21:31:12.089 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/6 页...
2026-01-12 21:31:12.089 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:31:12.111 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:31:13.105 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:14.358 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:16.554 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:16.554 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:31:17.089 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224672 status=200 resp_size=113476
2026-01-12 21:31:17.089 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:31:17.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169560234?api_key=51job&timestamp=1768224677 status=200 resp_size=6595
2026-01-12 21:31:17.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224677&companyId=9200002&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4227
2026-01-12 21:31:26.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164840669?api_key=51job&timestamp=1768224684 status=200 resp_size=6300
2026-01-12 21:31:26.424 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224686&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:31:35.904 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162586922?api_key=51job&timestamp=1768224694 status=200 resp_size=4448
2026-01-12 21:31:36.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224695&companyId=9383822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2691
2026-01-12 21:31:37.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162205542?api_key=51job&timestamp=1768224697 status=200 resp_size=5069
2026-01-12 21:31:37.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224697&companyId=9386397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:31:44.895 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169600143?api_key=51job&timestamp=1768224703 status=200 resp_size=5611
2026-01-12 21:31:45.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224704&companyId=2660857&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7869
2026-01-12 21:31:47.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041219?api_key=51job&timestamp=1768224707 status=200 resp_size=5799
2026-01-12 21:31:47.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224707&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:31:51.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165192500?api_key=51job&timestamp=1768224710 status=200 resp_size=6323
2026-01-12 21:31:51.492 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224711&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:31:58.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169854625?api_key=51job&timestamp=1768224717 status=200 resp_size=4476
2026-01-12 21:31:58.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224718&companyId=10094094&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3446
2026-01-12 21:32:06.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151355039?api_key=51job&timestamp=1768224725 status=200 resp_size=6456
2026-01-12 21:32:06.552 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224726&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:32:15.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894636?api_key=51job&timestamp=1768224734 status=200 resp_size=6410
2026-01-12 21:32:16.461 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224735&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 21:32:24.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165537713?api_key=51job&timestamp=1768224743 status=200 resp_size=5257
2026-01-12 21:32:24.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224744&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:32:32.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635815?api_key=51job&timestamp=1768224751 status=200 resp_size=6209
2026-01-12 21:32:32.344 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224752&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:32:43.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170179144?api_key=51job&timestamp=1768224762 status=200 resp_size=5827
2026-01-12 21:32:43.931 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224763&companyId=10142414&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2923
2026-01-12 21:32:52.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162129888?api_key=51job&timestamp=1768224771 status=200 resp_size=4693
2026-01-12 21:32:52.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224772&companyId=9310148&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2769
2026-01-12 21:33:02.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166626040?api_key=51job&timestamp=1768224780 status=200 resp_size=5731
2026-01-12 21:33:02.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224782&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:33:11.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150574823?api_key=51job&timestamp=1768224790 status=200 resp_size=6863
2026-01-12 21:33:11.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224791&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:33:19.899 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151060076?api_key=51job&timestamp=1768224798 status=200 resp_size=5835
2026-01-12 21:33:20.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224799&companyId=5416321&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5565
2026-01-12 21:33:22.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165106577?api_key=51job&timestamp=1768224802 status=200 resp_size=6016
2026-01-12 21:33:23.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224802&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:33:29.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134297663?api_key=51job&timestamp=1768224808 status=200 resp_size=5455
2026-01-12 21:33:29.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224809&companyId=3916562&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4108
2026-01-12 21:33:36.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170155222?api_key=51job&timestamp=1768224815 status=200 resp_size=6794
2026-01-12 21:33:36.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224816&companyId=10011319&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6666
2026-01-12 21:33:36.995 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:33:37.039 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:33:37.039 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:33:43.517 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.48 秒后继续...
2026-01-12 21:33:43.517 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/6 页...
2026-01-12 21:33:43.517 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:33:43.530 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:33:44.424 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:45.633 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:47.846 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:47.847 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:33:48.534 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224823 status=200 resp_size=124877
2026-01-12 21:33:48.535 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:33:48.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170192420?api_key=51job&timestamp=1768224828 status=200 resp_size=5000
2026-01-12 21:33:49.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224828&companyId=5556717&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12435
2026-01-12 21:33:51.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167400733?api_key=51job&timestamp=1768224831 status=200 resp_size=5730
2026-01-12 21:33:52.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224831&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:33:53.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166167328?api_key=51job&timestamp=1768224833 status=200 resp_size=5850
2026-01-12 21:33:53.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224833&companyId=2779923&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5250
2026-01-12 21:33:56.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167459547?api_key=51job&timestamp=1768224835 status=200 resp_size=5611
2026-01-12 21:33:56.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224836&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:33:59.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167301548?api_key=51job&timestamp=1768224839 status=200 resp_size=6723
2026-01-12 21:33:59.761 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224839&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:34:01.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165122479?api_key=51job&timestamp=1768224841 status=200 resp_size=5998
2026-01-12 21:34:02.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224841&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:34:11.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169052458?api_key=51job&timestamp=1768224850 status=200 resp_size=6395
2026-01-12 21:34:11.676 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224851&companyId=2779923&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5250
2026-01-12 21:34:13.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166772390?api_key=51job&timestamp=1768224853 status=200 resp_size=5895
2026-01-12 21:34:13.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224853&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:17.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169105610?api_key=51job&timestamp=1768224857 status=200 resp_size=5593
2026-01-12 21:34:17.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224857&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:34:23.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170229573?api_key=51job&timestamp=1768224862 status=200 resp_size=5438
2026-01-12 21:34:24.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224863&companyId=8933985&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4000
2026-01-12 21:34:31.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184212?api_key=51job&timestamp=1768224870 status=200 resp_size=4129
2026-01-12 21:34:31.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224871&companyId=10145218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2834
2026-01-12 21:34:38.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166396550?api_key=51job&timestamp=1768224878 status=200 resp_size=5887
2026-01-12 21:34:39.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224878&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:49.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165801635?api_key=51job&timestamp=1768224887 status=200 resp_size=5562
2026-01-12 21:34:49.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224889&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:56.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162279496?api_key=51job&timestamp=1768224895 status=200 resp_size=6619
2026-01-12 21:34:56.289 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224896&companyId=7627786&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5445
2026-01-12 21:35:01.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167367600?api_key=51job&timestamp=1768224900 status=200 resp_size=6808
2026-01-12 21:35:01.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224901&companyId=9551553&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6108
2026-01-12 21:35:10.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167851472?api_key=51job&timestamp=1768224910 status=200 resp_size=5924
2026-01-12 21:35:11.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224910&companyId=9827590&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3015
2026-01-12 21:35:16.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168426939?api_key=51job&timestamp=1768224915 status=200 resp_size=7231
2026-01-12 21:35:16.397 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224916&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:35:25.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002251?api_key=51job&timestamp=1768224923 status=200 resp_size=6466
2026-01-12 21:35:26.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224925&companyId=9912798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8440
2026-01-12 21:35:33.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081869?api_key=51job&timestamp=1768224932 status=200 resp_size=6339
2026-01-12 21:35:33.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224933&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-12 21:35:38.366 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800843?api_key=51job&timestamp=1768224938 status=200 resp_size=5571
2026-01-12 21:35:38.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224938&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:35:38.599 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:35:46.770 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:35:46.770 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:35:56.569 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.80 秒后继续...
2026-01-12 21:35:56.569 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/6 页...
2026-01-12 21:35:56.570 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:35:56.597 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:35:57.390 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:35:58.577 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:36:00.748 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:36:00.748 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:36:01.177 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224956 status=200 resp_size=120149
2026-01-12 21:36:01.178 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:36:01.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962902?api_key=51job&timestamp=1768224961 status=200 resp_size=5889
2026-01-12 21:36:01.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224961&companyId=9896020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7398
2026-01-12 21:36:05.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256476?api_key=51job&timestamp=1768224964 status=200 resp_size=6321
2026-01-12 21:36:05.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224965&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:36:15.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169576210?api_key=51job&timestamp=1768224973 status=200 resp_size=5581
2026-01-12 21:36:16.645 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224975&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:36:18.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086375?api_key=51job&timestamp=1768224978 status=200 resp_size=5237
2026-01-12 21:36:18.715 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224978&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:36:22.189 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167048652?api_key=51job&timestamp=1768224981 status=200 resp_size=6607
2026-01-12 21:36:22.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224982&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 21:36:25.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170189067?api_key=51job&timestamp=1768224984 status=200 resp_size=5464
2026-01-12 21:36:26.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224985&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:36:34.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169963008?api_key=51job&timestamp=1768224993 status=200 resp_size=6012
2026-01-12 21:36:34.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224994&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:36:46.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168446553?api_key=51job&timestamp=1768225000 status=200 resp_size=6339
2026-01-12 21:36:47.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225006&companyId=9673973&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4319
2026-01-12 21:36:53.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962771?api_key=51job&timestamp=1768225012 status=200 resp_size=5874
2026-01-12 21:36:53.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225013&companyId=9896020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7398
2026-01-12 21:37:04.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071365?api_key=51job&timestamp=1768225023 status=200 resp_size=6503
2026-01-12 21:37:05.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225024&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:37:12.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962991?api_key=51job&timestamp=1768225032 status=200 resp_size=6063
2026-01-12 21:37:12.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225032&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:37:16.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167301470?api_key=51job&timestamp=1768225036 status=200 resp_size=6243
2026-01-12 21:37:17.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225036&companyId=9673973&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4319
2026-01-12 21:37:28.032 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169340566?api_key=51job&timestamp=1768225044 status=200 resp_size=5558
2026-01-12 21:37:28.271 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225048&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:37:35.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169023029?api_key=51job&timestamp=1768225054 status=200 resp_size=6205
2026-01-12 21:37:36.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225055&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:37:43.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381242?api_key=51job&timestamp=1768225062 status=200 resp_size=5783
2026-01-12 21:37:43.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225063&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:37:51.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170027787?api_key=51job&timestamp=1768225070 status=200 resp_size=7013
2026-01-12 21:37:52.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225071&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:38:01.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184669?api_key=51job&timestamp=1768225080 status=200 resp_size=5554
2026-01-12 21:38:01.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225081&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:38:06.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169345561?api_key=51job&timestamp=1768225086 status=200 resp_size=7249
2026-01-12 21:38:06.921 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225086&companyId=7537623&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9097
2026-01-12 21:38:16.510 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259038?api_key=51job&timestamp=1768225095 status=200 resp_size=5678
2026-01-12 21:38:17.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225096&companyId=9898773&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2705
2026-01-12 21:38:19.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166229241?api_key=51job&timestamp=1768225099 status=200 resp_size=7488
2026-01-12 21:38:19.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225099&companyId=2380332&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6017
2026-01-12 21:38:19.867 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 21:38:19.899 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:38:19.899 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 21:38:28.394 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.49 秒后继续...
2026-01-12 21:38:28.394 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/6 页...
2026-01-12 21:38:28.394 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:38:28.409 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:38:29.363 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:30.772 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:33.119 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:33.119 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:38:33.678 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225108 status=200 resp_size=126778
2026-01-12 21:38:33.678 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:38:34.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168787979?api_key=51job&timestamp=1768225113 status=200 resp_size=5664
2026-01-12 21:38:34.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225114&companyId=9898773&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2705
2026-01-12 21:38:36.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161446376?api_key=51job&timestamp=1768225116 status=200 resp_size=5504
2026-01-12 21:38:36.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225116&companyId=3916562&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4108
2026-01-12 21:38:39.896 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166470176?api_key=51job&timestamp=1768225119 status=200 resp_size=7708
2026-01-12 21:38:40.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225119&companyId=9016711&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8114
2026-01-12 21:38:47.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168413793?api_key=51job&timestamp=1768225126 status=200 resp_size=6200
2026-01-12 21:38:48.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225127&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-12 21:38:49.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163032742?api_key=51job&timestamp=1768225129 status=200 resp_size=6191
2026-01-12 21:38:50.005 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225129&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:38:57.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167299530?api_key=51job&timestamp=1768225136 status=200 resp_size=5071
2026-01-12 21:38:58.389 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225137&companyId=2248750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12778
2026-01-12 21:39:05.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169127131?api_key=51job&timestamp=1768225144 status=200 resp_size=5931
2026-01-12 21:39:05.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225145&companyId=9237592&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3625
2026-01-12 21:39:13.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164795933?api_key=51job&timestamp=1768225152 status=200 resp_size=5743
2026-01-12 21:39:14.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225153&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:39:23.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169434756?api_key=51job&timestamp=1768225161 status=200 resp_size=5578
2026-01-12 21:39:24.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225163&companyId=5176547&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18708
2026-01-12 21:39:34.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169492333?api_key=51job&timestamp=1768225172 status=200 resp_size=5940
2026-01-12 21:39:35.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225174&companyId=9404026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3016
2026-01-12 21:39:40.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168983572?api_key=51job&timestamp=1768225179 status=200 resp_size=5532
2026-01-12 21:39:40.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225180&companyId=9825106&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5539
2026-01-12 21:39:47.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167943013?api_key=51job&timestamp=1768225186 status=200 resp_size=5697
2026-01-12 21:39:47.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225187&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:39:51.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152802087?api_key=51job&timestamp=1768225191 status=200 resp_size=6395
2026-01-12 21:39:51.941 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225191&companyId=2338889&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11565
2026-01-12 21:40:00.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165012326?api_key=51job&timestamp=1768225197 status=200 resp_size=5674
2026-01-12 21:40:01.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225200&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:40:06.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079888?api_key=51job&timestamp=1768225205 status=200 resp_size=5055
2026-01-12 21:40:06.528 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225206&companyId=10135176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2798
2026-01-12 21:40:17.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169986528?api_key=51job&timestamp=1768225215 status=200 resp_size=4877
2026-01-12 21:40:17.327 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225217&companyId=10126017&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2858
2026-01-12 21:40:19.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167267764?api_key=51job&timestamp=1768225219 status=200 resp_size=5636
2026-01-12 21:40:20.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225219&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:40:28.846 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088660?api_key=51job&timestamp=1768225227 status=200 resp_size=4283
2026-01-12 21:40:29.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225228&companyId=10136600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2746
2026-01-12 21:40:39.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170051234?api_key=51job&timestamp=1768225235 status=200 resp_size=4843
2026-01-12 21:40:39.335 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225239&companyId=10132312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:40:41.800 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169894319?api_key=51job&timestamp=1768225241 status=200 resp_size=4883
2026-01-12 21:40:42.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225241&companyId=10116649&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2780
2026-01-12 21:40:42.084 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 21:40:58.384 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:40:58.385 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 21:41:06.912 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.53 秒后继续...
2026-01-12 21:41:06.912 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/6 页...
2026-01-12 21:41:06.913 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:06.936 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:41:08.205 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:09.914 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:12.244 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:12.244 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:41:12.766 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225266 status=200 resp_size=11246
2026-01-12 21:41:12.766 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 2 个职位（去重后: 2） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:41:13.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164953605?api_key=51job&timestamp=1768225272 status=200 resp_size=4944
2026-01-12 21:41:14.695 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225273&companyId=726892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6645
2026-01-12 21:41:25.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919310?api_key=51job&timestamp=1768225284 status=200 resp_size=4229
2026-01-12 21:41:26.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225285&companyId=10119903&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 21:41:26.011 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 2
2026-01-12 21:41:42.199 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 2, 响应大小: 112 字节
2026-01-12 21:41:42.199 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 2 个职位 | 累计: 102 个
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (102/102)，提前结束爬取
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 102 条
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 102 条
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 102 条
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 6 页
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 兰州(270200)
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 岩土工程(2119)
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (102/102)
2026-01-12 21:41:42.200 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:41:42.201 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:41:42.201 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 102 条记录)
2026-01-12 21:41:42.201 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 102 个职位
2026-01-12 21:41:42.201 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:41:43.662 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.696 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.750 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 温州 (80400)
2026-01-12 21:41:43.751 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 团购业务员 (3008)
2026-01-12 21:41:43.751 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:41:43.751 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:41:43.751 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:41:43.751 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:41:43.751 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:41:43.751 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.764 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:41:44.681 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:45.898 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:48.113 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:48.113 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:41:48.806 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225303 status=200 resp_size=123934
2026-01-12 21:41:48.806 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:41:49.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768225308 status=200 resp_size=5976
2026-01-12 21:41:49.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225309&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 21:41:56.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768225315 status=200 resp_size=5589
2026-01-12 21:41:56.988 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225316&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:06.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768225325 status=200 resp_size=5194
2026-01-12 21:42:06.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225326&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:19.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768225335 status=200 resp_size=5556
2026-01-12 21:42:19.765 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225339&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:25.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768225343 status=200 resp_size=6337
2026-01-12 21:42:26.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225345&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 21:42:31.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768225350 status=200 resp_size=5643
2026-01-12 21:42:31.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225351&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:39.602 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768225358 status=200 resp_size=5175
2026-01-12 21:42:39.790 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225359&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 21:42:50.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768225368 status=200 resp_size=8637
2026-01-12 21:42:50.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225370&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 21:42:56.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768225375 status=200 resp_size=6170
2026-01-12 21:42:56.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225376&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 21:42:58.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768225378 status=200 resp_size=6609
2026-01-12 21:42:59.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225378&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 21:43:10.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768225386 status=200 resp_size=5893
2026-01-12 21:43:10.615 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225390&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 21:43:21.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768225400 status=200 resp_size=6056
2026-01-12 21:43:22.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225401&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:43:31.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768225409 status=200 resp_size=6417
2026-01-12 21:43:31.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:43:40.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768225419 status=200 resp_size=5813
2026-01-12 21:43:42.396 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225420&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:43:49.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768225427 status=200 resp_size=4918
2026-01-12 21:43:49.699 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225429&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 21:43:56.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768225435 status=200 resp_size=6081
2026-01-12 21:43:57.253 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225436&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:44:09.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768225446 status=200 resp_size=6980
2026-01-12 21:44:09.279 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225449&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 21:44:11.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768225450 status=200 resp_size=7054
2026-01-12 21:44:12.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225451&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 21:44:16.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768225456 status=200 resp_size=5738
2026-01-12 21:44:46.676 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 21:44:48.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225456&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:44:55.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768225494 status=200 resp_size=5476
2026-01-12 21:44:55.585 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225495&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 21:44:55.585 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:44:55.643 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:44:55.643 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 21:44:55.643 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:44:57.003 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.36 秒后继续...
2026-01-12 21:44:57.003 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-12 21:44:57.003 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:44:57.015 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:44:58.013 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:44:59.214 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:45:01.422 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:45:01.422 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:45:01.915 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225497 status=200 resp_size=112174
2026-01-12 21:45:01.915 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:45:02.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768225501 status=200 resp_size=6033
2026-01-12 21:45:02.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225502&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 21:45:06.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768225506 status=200 resp_size=6264
2026-01-12 21:45:07.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225506&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 21:45:10.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768225510 status=200 resp_size=5738
2026-01-12 21:45:11.093 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225510&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 21:45:13.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768225513 status=200 resp_size=5638
2026-01-12 21:45:13.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225513&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:45:16.123 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768225515 status=200 resp_size=6386
2026-01-12 21:45:16.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225516&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 21:45:26.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768225523 status=200 resp_size=5098
2026-01-12 21:45:26.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225526&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:45:28.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768225528 status=200 resp_size=6273
2026-01-12 21:45:29.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225528&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:45:31.160 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768225530 status=200 resp_size=5371
2026-01-12 21:45:31.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225531&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 21:45:37.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768225536 status=200 resp_size=7193
2026-01-12 21:45:37.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225537&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 21:45:41.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768225541 status=200 resp_size=5184
2026-01-12 21:45:41.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225541&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:45:46.691 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768225546 status=200 resp_size=5022
2026-01-12 21:45:47.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225546&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 21:45:57.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768225555 status=200 resp_size=6134
2026-01-12 21:45:57.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225557&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 21:46:09.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768225567 status=200 resp_size=6193
2026-01-12 21:46:09.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225569&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 21:46:18.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768225577 status=200 resp_size=5612
2026-01-12 21:46:18.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225578&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:46:29.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768225588 status=200 resp_size=5128
2026-01-12 21:46:29.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225589&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 21:46:34.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768225594 status=200 resp_size=5975
2026-01-12 21:46:34.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225594&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 21:46:42.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768225601 status=200 resp_size=6322
2026-01-12 21:46:43.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225602&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 21:46:51.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768225610 status=200 resp_size=5628
2026-01-12 21:46:52.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225611&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:47:01.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768225620 status=200 resp_size=5839
2026-01-12 21:47:01.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225621&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:47:04.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768225623 status=200 resp_size=5407
2026-01-12 21:47:04.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225624&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:47:04.364 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:47:04.388 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:47:04.388 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:47:06.349 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.96 秒后继续...
2026-01-12 21:47:06.349 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-12 21:47:06.349 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:47:06.362 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:47:08.642 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:10.558 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:13.646 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:13.646 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:47:14.868 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225626 status=200 resp_size=110364
2026-01-12 21:47:14.868 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:47:15.945 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768225634 status=200 resp_size=5902
2026-01-12 21:47:16.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225635&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:47:21.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768225640 status=200 resp_size=5619
2026-01-12 21:47:21.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225641&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 21:47:25.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768225645 status=200 resp_size=5709
2026-01-12 21:47:25.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225645&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:47:35.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768225654 status=200 resp_size=5612
2026-01-12 21:47:36.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225655&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:47:43.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768225662 status=200 resp_size=6336
2026-01-12 21:47:43.868 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225663&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 21:47:53.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768225672 status=200 resp_size=6499
2026-01-12 21:47:53.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225673&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:48:03.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768225682 status=200 resp_size=5510
2026-01-12 21:48:03.916 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225683&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:48:12.029 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768225690 status=200 resp_size=5799
2026-01-12 21:48:12.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225692&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:48:15.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768225695 status=200 resp_size=6452
2026-01-12 21:48:15.909 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225695&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 21:48:20.829 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768225700 status=200 resp_size=5684
2026-01-12 21:48:21.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225700&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 21:48:29.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768225708 status=200 resp_size=6312
2026-01-12 21:48:29.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225709&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:48:31.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768225711 status=200 resp_size=5148
2026-01-12 21:48:32.146 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225711&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 21:48:38.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768225716 status=200 resp_size=5748
2026-01-12 21:48:38.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225718&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:48:45.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768225724 status=200 resp_size=5967
2026-01-12 21:48:46.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225725&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:48:52.968 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768225732 status=200 resp_size=5836
2026-01-12 21:48:53.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225732&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:49:02.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768225742 status=200 resp_size=5179
2026-01-12 21:49:03.110 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225742&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 21:49:10.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768225748 status=200 resp_size=8501
2026-01-12 21:49:11.257 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225750&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 21:49:20.726 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768225759 status=200 resp_size=5998
2026-01-12 21:49:20.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225760&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 21:49:26.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768225766 status=200 resp_size=6055
2026-01-12 21:49:27.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225766&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:49:35.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768225774 status=200 resp_size=5351
2026-01-12 21:49:35.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225775&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:49:35.396 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:49:35.434 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:49:35.434 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:49:42.315 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:49:42.316 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:49:57.780 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.828 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.855 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 漳州 (110500)
2026-01-12 21:49:57.855 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 商务专员 (3111)
2026-01-12 21:49:57.855 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:49:57.855 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:49:57.855 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:49:57.856 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:49:57.856 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:49:57.856 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.868 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:49:59.517 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:00.886 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:03.899 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:03.899 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:50:04.702 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225797 status=200 resp_size=122695
2026-01-12 21:50:04.702 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:50:05.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170218755?api_key=51job&timestamp=1768225804 status=200 resp_size=6795
2026-01-12 21:50:05.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225805&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:50:09.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162204846?api_key=51job&timestamp=1768225808 status=200 resp_size=5713
2026-01-12 21:50:09.819 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225809&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:50:17.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164867795?api_key=51job&timestamp=1768225815 status=200 resp_size=5442
2026-01-12 21:50:17.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225817&companyId=9496587&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2726
2026-01-12 21:50:18.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160028241?api_key=51job&timestamp=1768225818 status=200 resp_size=5705
2026-01-12 21:50:19.115 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225818&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:50:21.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162051274?api_key=51job&timestamp=1768225820 status=200 resp_size=6095
2026-01-12 21:50:21.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225821&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:50:29.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211072?api_key=51job&timestamp=1768225828 status=200 resp_size=5660
2026-01-12 21:50:29.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225829&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:50:34.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169878991?api_key=51job&timestamp=1768225834 status=200 resp_size=5387
2026-01-12 21:50:34.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225834&companyId=3322279&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6970
2026-01-12 21:50:44.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170179070?api_key=51job&timestamp=1768225841 status=200 resp_size=6269
2026-01-12 21:50:45.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225844&companyId=10141224&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:50:47.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217950?api_key=51job&timestamp=1768225847 status=200 resp_size=6719
2026-01-12 21:50:47.780 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225847&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:50:56.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161865729?api_key=51job&timestamp=1768225855 status=200 resp_size=6511
2026-01-12 21:50:56.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225856&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:07.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168054176?api_key=51job&timestamp=1768225866 status=200 resp_size=5597
2026-01-12 21:51:07.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225867&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-12 21:51:14.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170178984?api_key=51job&timestamp=1768225874 status=200 resp_size=6244
2026-01-12 21:51:15.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225874&companyId=10141224&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:51:17.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170220512?api_key=51job&timestamp=1768225877 status=200 resp_size=6226
2026-01-12 21:51:17.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225877&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:20.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162296304?api_key=51job&timestamp=1768225879 status=200 resp_size=6277
2026-01-12 21:51:20.215 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225880&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:28.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217915?api_key=51job&timestamp=1768225886 status=200 resp_size=6713
2026-01-12 21:51:28.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225888&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:32.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161498528?api_key=51job&timestamp=1768225891 status=200 resp_size=7173
2026-01-12 21:51:32.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225892&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:40.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169143188?api_key=51job&timestamp=1768225899 status=200 resp_size=6550
2026-01-12 21:51:40.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225900&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:51:44.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138851?api_key=51job&timestamp=1768225903 status=200 resp_size=6194
2026-01-12 21:51:44.230 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225904&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:46.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161624911?api_key=51job&timestamp=1768225906 status=200 resp_size=7927
2026-01-12 21:51:46.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225906&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:55.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170209275?api_key=51job&timestamp=1768225913 status=200 resp_size=5019
2026-01-12 21:51:55.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225915&companyId=10147480&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3084
2026-01-12 21:51:55.673 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:51:55.746 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:51:55.747 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 70 | 计算需要爬取: 4 页 (每页 20 条) | 预计最大数据: 80 条
2026-01-12 21:51:55.747 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:52:02.544 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.80 秒后继续...
2026-01-12 21:52:02.544 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/4 页...
2026-01-12 21:52:02.544 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:52:02.564 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:52:03.408 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:04.604 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:06.795 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:06.795 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:52:07.236 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225922 status=200 resp_size=123445
2026-01-12 21:52:07.237 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:52:07.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169818864?api_key=51job&timestamp=1768225927 status=200 resp_size=5494
2026-01-12 21:52:07.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225927&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:52:19.750 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170160750?api_key=51job&timestamp=1768225937 status=200 resp_size=5961
2026-01-12 21:52:20.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225939&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:52:26.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162842434?api_key=51job&timestamp=1768225945 status=200 resp_size=6201
2026-01-12 21:52:26.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225946&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:52:27.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169345173?api_key=51job&timestamp=1768225947 status=200 resp_size=7351
2026-01-12 21:52:27.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225947&companyId=7537623&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9097
2026-01-12 21:52:29.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173982?api_key=51job&timestamp=1768225949 status=200 resp_size=5545
2026-01-12 21:52:29.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225949&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:52:35.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170109443?api_key=51job&timestamp=1768225955 status=200 resp_size=5700
2026-01-12 21:52:36.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225955&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:52:43.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161905324?api_key=51job&timestamp=1768225962 status=200 resp_size=7364
2026-01-12 21:52:43.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225963&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:52:46.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048103?api_key=51job&timestamp=1768225966 status=200 resp_size=6503
2026-01-12 21:52:46.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225966&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:52:54.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167439146?api_key=51job&timestamp=1768225973 status=200 resp_size=6126
2026-01-12 21:52:54.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225974&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:53:04.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139576?api_key=51job&timestamp=1768225982 status=200 resp_size=7643
2026-01-12 21:53:04.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225984&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:53:11.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161646908?api_key=51job&timestamp=1768225990 status=200 resp_size=6679
2026-01-12 21:53:11.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225991&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:53:23.336 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086169?api_key=51job&timestamp=1768225999 status=200 resp_size=5568
2026-01-12 21:53:23.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226003&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:53:34.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256898?api_key=51job&timestamp=1768226012 status=200 resp_size=6345
2026-01-12 21:53:34.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226014&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:53:42.962 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170111509?api_key=51job&timestamp=1768226021 status=200 resp_size=6962
2026-01-12 21:53:43.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226022&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:53:47.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162142054?api_key=51job&timestamp=1768226027 status=200 resp_size=6533
2026-01-12 21:53:48.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226027&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:53:51.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168094297?api_key=51job&timestamp=1768226030 status=200 resp_size=5867
2026-01-12 21:53:51.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226031&companyId=9827590&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3015
2026-01-12 21:53:56.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079523?api_key=51job&timestamp=1768226036 status=200 resp_size=5799
2026-01-12 21:53:56.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226036&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:53:59.999 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132259?api_key=51job&timestamp=1768226039 status=200 resp_size=6389
2026-01-12 21:54:00.294 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226039&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:54:10.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161646421?api_key=51job&timestamp=1768226049 status=200 resp_size=6522
2026-01-12 21:54:10.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226050&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:54:14.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170078239?api_key=51job&timestamp=1768226054 status=200 resp_size=5880
2026-01-12 21:54:14.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226054&companyId=10128402&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2626
2026-01-12 21:54:14.673 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:54:14.709 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:54:14.709 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:54:22.743 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.03 秒后继续...
2026-01-12 21:54:22.743 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/4 页...
2026-01-12 21:54:22.743 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:54:22.771 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:54:23.359 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:24.496 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:26.622 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:26.622 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:54:27.018 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226062 status=200 resp_size=118417
2026-01-12 21:54:27.018 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:54:27.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188875?api_key=51job&timestamp=1768226067 status=200 resp_size=5391
2026-01-12 21:54:27.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226067&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:54:35.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170183207?api_key=51job&timestamp=1768226074 status=200 resp_size=5680
2026-01-12 21:54:35.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226075&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:54:44.305 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161509282?api_key=51job&timestamp=1768226083 status=200 resp_size=6361
2026-01-12 21:54:45.658 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226084&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:54:49.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168147253?api_key=51job&timestamp=1768226088 status=200 resp_size=6277
2026-01-12 21:54:50.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226089&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 21:54:58.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167937928?api_key=51job&timestamp=1768226098 status=200 resp_size=5730
2026-01-12 21:54:59.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226098&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:55:05.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170141771?api_key=51job&timestamp=1768226104 status=200 resp_size=6896
2026-01-12 21:55:05.795 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226105&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:55:13.456 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167177821?api_key=51job&timestamp=1768226112 status=200 resp_size=5682
2026-01-12 21:55:13.646 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226113&companyId=9872690&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5235
2026-01-12 21:55:22.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555071?api_key=51job&timestamp=1768226121 status=200 resp_size=6379
2026-01-12 21:55:22.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226122&companyId=9310196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2599
2026-01-12 21:55:30.586 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376489?api_key=51job&timestamp=1768226129 status=200 resp_size=7227
2026-01-12 21:55:30.843 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226130&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:55:37.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132102?api_key=51job&timestamp=1768226137 status=200 resp_size=6291
2026-01-12 21:55:37.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226137&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:55:48.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169130919?api_key=51job&timestamp=1768226147 status=200 resp_size=5562
2026-01-12 21:55:48.270 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226148&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:55:50.133 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638608?api_key=51job&timestamp=1768226149 status=200 resp_size=4432
2026-01-12 21:55:50.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226150&companyId=10092670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3181
2026-01-12 21:55:54.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168560095?api_key=51job&timestamp=1768226154 status=200 resp_size=6385
2026-01-12 21:55:54.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226154&companyId=9974974&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-12 21:56:01.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131857?api_key=51job&timestamp=1768226161 status=200 resp_size=6262
2026-01-12 21:56:01.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226161&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:10.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162311179?api_key=51job&timestamp=1768226170 status=200 resp_size=6346
2026-01-12 21:56:11.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226170&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:56:14.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170183615?api_key=51job&timestamp=1768226174 status=200 resp_size=5685
2026-01-12 21:56:15.053 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226174&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:16.470 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184252?api_key=51job&timestamp=1768226176 status=200 resp_size=7233
2026-01-12 21:56:16.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226176&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:20.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467846?api_key=51job&timestamp=1768226180 status=200 resp_size=6423
2026-01-12 21:56:21.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226180&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:56:23.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170164986?api_key=51job&timestamp=1768226183 status=200 resp_size=6485
2026-01-12 21:56:24.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226183&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:31.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131125?api_key=51job&timestamp=1768226190 status=200 resp_size=6233
2026-01-12 21:56:31.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226191&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:31.440 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:56:39.673 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:56:39.674 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:56:47.598 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.92 秒后继续...
2026-01-12 21:56:47.598 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/4 页...
2026-01-12 21:56:47.598 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:56:47.619 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:56:48.416 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:49.606 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:52.177 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:52.177 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:56:52.817 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226207 status=200 resp_size=62234
2026-01-12 21:56:52.817 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 10 个职位（去重后: 10） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:56:53.135 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165409?api_key=51job&timestamp=1768226212 status=200 resp_size=6663
2026-01-12 21:56:53.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226213&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:58.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110782?api_key=51job&timestamp=1768226218 status=200 resp_size=6393
2026-01-12 21:56:59.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226218&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:05.426 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170153269?api_key=51job&timestamp=1768226224 status=200 resp_size=7617
2026-01-12 21:57:05.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226225&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:13.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170186727?api_key=51job&timestamp=1768226232 status=200 resp_size=7298
2026-01-12 21:57:14.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226233&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:22.411 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131334?api_key=51job&timestamp=1768226241 status=200 resp_size=6647
2026-01-12 21:57:22.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226242&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:31.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170160626?api_key=51job&timestamp=1768226250 status=200 resp_size=6481
2026-01-12 21:57:31.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226251&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:38.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131282?api_key=51job&timestamp=1768226257 status=200 resp_size=6597
2026-01-12 21:57:38.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226258&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:43.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170163037?api_key=51job&timestamp=1768226263 status=200 resp_size=6255
2026-01-12 21:57:43.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226263&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:45.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184193?api_key=51job&timestamp=1768226265 status=200 resp_size=7256
2026-01-12 21:57:45.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226265&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:49.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165380?api_key=51job&timestamp=1768226269 status=200 resp_size=6744
2026-01-12 21:57:49.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226269&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:49.618 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 10
2026-01-12 21:57:49.681 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 10, 响应大小: 113 字节
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 10 个职位 | 累计: 70 个
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (70/70)，提前结束爬取
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 70 条
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 70 条
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 70 条
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 4 页
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 漳州(110500)
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 商务专员(3111)
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (70/70)
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:57:49.681 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:57:49.681 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 70 条记录)
2026-01-12 21:57:49.681 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 70 个职位
2026-01-12 21:57:49.681 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:57:54.906 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:54.917 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:55.012 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 六安 (151200)
2026-01-12 21:57:55.012 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 党工团干事 (2310)
2026-01-12 21:57:55.012 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:57:55.012 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:57:55.012 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 六安(151200) | 职能: 党工团干事(2310)
2026-01-12 21:57:55.012 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:57:55.012 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:57:55.012 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:55.059 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=151200, 工作类型=2310
2026-01-12 21:57:56.006 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:57.147 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:59.261 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:59.261 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:57:59.677 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226275 status=200 resp_size=120405
2026-01-12 21:57:59.678 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 18 个职位（去重后: 18） | API返回totalCount: 18 (原始值: 18) | 地区: 六安(151200) | 职能: 党工团干事(2310)
2026-01-12 21:58:00.171 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168755516?api_key=51job&timestamp=1768226279 status=200 resp_size=6655
2026-01-12 21:58:00.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226280&companyId=9325380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 21:58:07.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269222?api_key=51job&timestamp=1768226287 status=200 resp_size=6959
2026-01-12 21:58:07.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226287&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:58:15.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519478?api_key=51job&timestamp=1768226293 status=200 resp_size=5510
2026-01-12 21:58:15.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226295&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:58:17.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159348703?api_key=51job&timestamp=1768226296 status=200 resp_size=5314
2026-01-12 21:58:17.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226297&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:58:20.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563891?api_key=51job&timestamp=1768226299 status=200 resp_size=7042
2026-01-12 21:58:21.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226300&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:58:29.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150177353?api_key=51job&timestamp=1768226306 status=200 resp_size=6010
2026-01-12 21:58:31.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226309&companyId=4927060&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10278
2026-01-12 21:58:34.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169301030?api_key=51job&timestamp=1768226314 status=200 resp_size=6997
2026-01-12 21:58:35.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226314&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:58:39.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165696377?api_key=51job&timestamp=1768226318 status=200 resp_size=7078
2026-01-12 21:58:39.855 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226319&companyId=9414151&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4971
2026-01-12 21:58:49.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376978?api_key=51job&timestamp=1768226329 status=200 resp_size=7227
2026-01-12 21:58:49.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226329&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:58:52.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048026?api_key=51job&timestamp=1768226332 status=200 resp_size=6503
2026-01-12 21:58:52.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226332&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:59:01.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079479?api_key=51job&timestamp=1768226339 status=200 resp_size=5799
2026-01-12 21:59:01.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226341&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:59:07.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161655823?api_key=51job&timestamp=1768226346 status=200 resp_size=6353
2026-01-12 21:59:07.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226347&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:59:09.252 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169745285?api_key=51job&timestamp=1768226349 status=200 resp_size=7163
2026-01-12 21:59:09.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226349&companyId=10016288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5913
2026-01-12 21:59:19.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169827686?api_key=51job&timestamp=1768226358 status=200 resp_size=4409
2026-01-12 21:59:19.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226359&companyId=10110765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3208
2026-01-12 21:59:28.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162563417?api_key=51job&timestamp=1768226367 status=200 resp_size=4772
2026-01-12 21:59:28.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226368&companyId=4332821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9331
2026-01-12 21:59:30.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146156625?api_key=51job&timestamp=1768226370 status=200 resp_size=5501
2026-01-12 21:59:31.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226370&companyId=4225876&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7322
2026-01-12 21:59:41.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168755415?api_key=51job&timestamp=1768226380 status=200 resp_size=6626
2026-01-12 21:59:42.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226381&companyId=9325380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 21:59:44.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169355251?api_key=51job&timestamp=1768226384 status=200 resp_size=6550
2026-01-12 21:59:44.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226384&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:59:44.885 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 18
2026-01-12 21:59:44.924 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 21:59:44.924 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 18 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:59:44.924 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 18 个职位 | 累计: 18 个
2026-01-12 21:59:44.924 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (18/18)，提前结束爬取
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 18 条
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 18 条
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 0 条
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 18 条
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 1 页
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 六安(151200)
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 党工团干事(2310)
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 100.00% (18/18)
2026-01-12 21:59:44.925 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 21:59:44.926 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:59:44.926 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 18 条记录)
2026-01-12 21:59:44.926 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 18 个职位
2026-01-12 21:59:44.926 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:59:51.866 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.881 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.909 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 河源 (32100)
2026-01-12 21:59:51.911 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 高级硬件工程师 (2956)
2026-01-12 21:59:51.911 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:59:51.911 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:59:51.911 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 21:59:51.911 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:59:51.911 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 21:59:51.911 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.925 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 21:59:52.694 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:53.891 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:56.074 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:56.074 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:59:56.634 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226391 status=200 resp_size=124061
2026-01-12 21:59:56.634 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 21:59:56.886 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768226396 status=200 resp_size=5976
2026-01-12 21:59:57.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226396&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:00:06.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768226405 status=200 resp_size=5583
2026-01-12 22:00:06.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226406&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:13.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768226412 status=200 resp_size=5188
2026-01-12 22:00:13.474 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226413&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:21.148 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768226419 status=200 resp_size=5634
2026-01-12 22:00:21.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226421&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:25.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768226424 status=200 resp_size=6332
2026-01-12 22:00:25.307 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226425&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 22:00:31.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768226430 status=200 resp_size=5550
2026-01-12 22:00:32.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226431&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:37.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768226436 status=200 resp_size=5175
2026-01-12 22:00:37.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226437&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 22:00:48.929 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768226446 status=200 resp_size=8637
2026-01-12 22:00:49.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226448&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 22:00:53.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768226452 status=200 resp_size=6170
2026-01-12 22:00:54.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226453&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 22:01:05.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768226464 status=200 resp_size=6609
2026-01-12 22:01:05.717 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226465&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 22:01:13.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768226471 status=200 resp_size=5893
2026-01-12 22:01:13.365 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226473&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 22:01:17.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768226477 status=200 resp_size=6056
2026-01-12 22:01:18.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226477&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:01:25.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768226484 status=200 resp_size=6417
2026-01-12 22:01:25.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226485&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:01:33.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768226491 status=200 resp_size=5813
2026-01-12 22:01:33.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226493&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:01:35.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768226495 status=200 resp_size=4916
2026-01-12 22:01:36.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226495&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 22:01:46.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768226504 status=200 resp_size=6081
2026-01-12 22:01:46.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226506&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:01:49.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768226509 status=200 resp_size=6980
2026-01-12 22:01:49.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226509&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 22:01:57.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768226516 status=200 resp_size=7054
2026-01-12 22:01:57.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226517&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 22:02:04.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768226523 status=200 resp_size=5738
2026-01-12 22:02:04.784 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226524&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:02:06.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768226526 status=200 resp_size=5476
2026-01-12 22:02:06.671 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226526&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 22:02:06.671 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 22:02:06.718 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:02:06.718 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 22:02:06.718 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 22:02:10.347 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.63 秒后继续...
2026-01-12 22:02:10.347 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-12 22:02:10.348 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:02:10.369 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:02:11.163 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:12.357 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:14.544 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:14.544 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:02:15.078 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226530 status=200 resp_size=112004
2026-01-12 22:02:15.078 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:02:15.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768226535 status=200 resp_size=6037
2026-01-12 22:02:15.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226535&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:02:19.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768226539 status=200 resp_size=6268
2026-01-12 22:02:19.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226539&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 22:02:30.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768226549 status=200 resp_size=5738
2026-01-12 22:02:30.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226550&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 22:02:41.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768226559 status=200 resp_size=5638
2026-01-12 22:02:41.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226561&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:02:51.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768226570 status=200 resp_size=6386
2026-01-12 22:02:51.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226571&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 22:02:54.698 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768226574 status=200 resp_size=5098
2026-01-12 22:02:54.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226574&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:02:59.861 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768226579 status=200 resp_size=6273
2026-01-12 22:03:00.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226579&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 22:03:04.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768226583 status=200 resp_size=5373
2026-01-12 22:03:04.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226584&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 22:03:11.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768226590 status=200 resp_size=6433
2026-01-12 22:03:11.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226591&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:03:21.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768226600 status=200 resp_size=5186
2026-01-12 22:03:21.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226601&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 22:03:24.576 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768226604 status=200 resp_size=5022
2026-01-12 22:03:24.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226604&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 22:03:33.226 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768226612 status=200 resp_size=6134
2026-01-12 22:03:33.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226613&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 22:03:37.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768226616 status=200 resp_size=7193
2026-01-12 22:03:37.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226617&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 22:03:40.155 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768226619 status=200 resp_size=5612
2026-01-12 22:03:40.356 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226620&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 22:03:47.953 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768226627 status=200 resp_size=5128
2026-01-12 22:03:48.165 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226627&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 22:03:55.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768226634 status=200 resp_size=5970
2026-01-12 22:03:55.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226635&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 22:04:02.090 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768226641 status=200 resp_size=6322
2026-01-12 22:04:02.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226642&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:04:10.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768226649 status=200 resp_size=5623
2026-01-12 22:04:10.885 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226650&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:04:20.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768226659 status=200 resp_size=5839
2026-01-12 22:04:20.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226660&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:04:28.491 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768226666 status=200 resp_size=5407
2026-01-12 22:04:28.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226668&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:04:28.840 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 22:04:28.866 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:04:28.866 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 22:04:31.818 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.95 秒后继续...
2026-01-12 22:04:31.818 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-12 22:04:31.819 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:04:31.838 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:04:33.352 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:35.643 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:38.060 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:38.060 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:04:39.261 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226671 status=200 resp_size=110362
2026-01-12 22:04:39.262 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:04:39.611 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768226679 status=200 resp_size=5902
2026-01-12 22:04:39.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226679&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:04:44.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768226684 status=200 resp_size=5619
2026-01-12 22:04:45.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226684&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 22:04:54.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768226693 status=200 resp_size=5704
2026-01-12 22:04:54.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226694&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:05:04.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768226702 status=200 resp_size=5612
2026-01-12 22:05:05.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226704&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:05:12.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768226711 status=200 resp_size=6336
2026-01-12 22:05:12.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226712&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 22:05:16.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768226716 status=200 resp_size=6499
2026-01-12 22:05:16.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226716&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:05:18.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768226718 status=200 resp_size=5519
2026-01-12 22:05:18.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226718&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:05:22.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768226722 status=200 resp_size=5799
2026-01-12 22:05:22.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226722&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:05:31.812 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768226731 status=200 resp_size=6452
2026-01-12 22:05:31.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226731&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 22:05:35.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768226735 status=200 resp_size=5684
2026-01-12 22:05:35.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226735&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 22:05:43.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768226741 status=200 resp_size=6307
2026-01-12 22:05:43.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226743&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 22:05:47.582 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768226747 status=200 resp_size=5148
2026-01-12 22:05:48.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226747&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 22:05:51.083 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768226750 status=200 resp_size=5748
2026-01-12 22:05:52.009 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226751&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:06:01.794 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768226759 status=200 resp_size=5967
2026-01-12 22:06:02.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226761&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:06:08.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768226767 status=200 resp_size=5836
2026-01-12 22:06:08.601 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226768&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:06:13.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768226773 status=200 resp_size=5179
2026-01-12 22:06:13.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226773&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 22:06:15.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768226775 status=200 resp_size=8501
2026-01-12 22:06:15.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226775&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 22:06:17.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768226777 status=200 resp_size=6003
2026-01-12 22:06:17.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226777&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 22:06:26.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768226784 status=200 resp_size=6055
2026-01-12 22:06:26.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226786&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:06:33.743 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768226792 status=200 resp_size=5351
2026-01-12 22:06:33.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226793&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:06:33.953 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 22:06:33.989 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:06:33.989 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 22:06:43.726 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.73 秒后继续...
2026-01-12 22:06:43.726 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-12 22:06:43.726 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:06:43.756 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:06:44.594 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:45.786 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:47.961 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:47.961 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:06:48.485 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226803 status=200 resp_size=120371
2026-01-12 22:06:48.486 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:06:48.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768226808 status=200 resp_size=5295
2026-01-12 22:06:49.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226808&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-12 22:06:57.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768226816 status=200 resp_size=5734
2026-01-12 22:06:57.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226817&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:07:02.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768226821 status=200 resp_size=5762
2026-01-12 22:07:02.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226822&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:07:12.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768226832 status=200 resp_size=5946
2026-01-12 22:07:13.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226832&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:07:20.029 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768226839 status=200 resp_size=5464
2026-01-12 22:07:20.349 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226840&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-12 22:07:24.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768226844 status=200 resp_size=5733
2026-01-12 22:07:24.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226844&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:07:28.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768226847 status=200 resp_size=6158
2026-01-12 22:07:28.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226848&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:07:40.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161093063?api_key=51job&timestamp=1768226857 status=200 resp_size=4899
2026-01-12 22:07:40.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226860&companyId=9298193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 22:07:42.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169107661?api_key=51job&timestamp=1768226862 status=200 resp_size=6884
2026-01-12 22:07:42.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226862&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:07:53.488 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768226872 status=200 resp_size=5238
2026-01-12 22:07:53.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226873&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:01.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768226880 status=200 resp_size=6030
2026-01-12 22:08:01.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226881&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 22:08:05.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768226883 status=200 resp_size=5488
2026-01-12 22:08:06.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226885&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:08:16.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768226895 status=200 resp_size=5925
2026-01-12 22:08:16.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226896&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 22:08:21.661 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768226900 status=200 resp_size=5278
2026-01-12 22:08:21.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226901&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:08:34.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768226907 status=200 resp_size=5640
2026-01-12 22:08:35.277 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226914&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:44.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768226923 status=200 resp_size=5894
2026-01-12 22:08:45.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226924&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:54.251 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768226932 status=200 resp_size=7780
2026-01-12 22:08:54.545 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226934&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 22:09:05.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768226944 status=200 resp_size=6669
2026-01-12 22:09:05.246 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226945&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:07.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768226947 status=200 resp_size=4201
2026-01-12 22:09:07.657 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226947&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-12 22:09:17.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768226956 status=200 resp_size=6444
2026-01-12 22:09:18.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226957&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:18.540 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 22:09:18.574 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:09:18.574 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 22:09:27.045 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.47 秒后继续...
2026-01-12 22:09:27.045 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-12 22:09:27.046 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:09:27.090 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:09:27.814 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:28.981 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:31.151 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:31.151 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:09:31.622 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226967 status=200 resp_size=125601
2026-01-12 22:09:31.623 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:09:31.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768226971 status=200 resp_size=6070
2026-01-12 22:09:32.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226971&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:09:38.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768226977 status=200 resp_size=6201
2026-01-12 22:09:38.635 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226978&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 22:09:46.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768226985 status=200 resp_size=6410
2026-01-12 22:09:46.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226986&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:49.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768226989 status=200 resp_size=6079
2026-01-12 22:09:49.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226989&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 22:10:00.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768226999 status=200 resp_size=6874
2026-01-12 22:10:00.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227000&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8133
2026-01-12 22:10:09.108 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768227008 status=200 resp_size=6551
2026-01-12 22:10:09.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227009&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:10:10.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169552998?api_key=51job&timestamp=1768227010 status=200 resp_size=5859
2026-01-12 22:10:11.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227010&companyId=10081630&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2698
2026-01-12 22:10:14.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768227014 status=200 resp_size=5923
2026-01-12 22:10:15.179 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227014&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:10:25.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167749069?api_key=51job&timestamp=1768227024 status=200 resp_size=6231
2026-01-12 22:10:25.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227025&companyId=296713&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7824
2026-01-12 22:10:32.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768227032 status=200 resp_size=5508
2026-01-12 22:10:32.960 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227032&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-12 22:10:36.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129561?api_key=51job&timestamp=1768227036 status=200 resp_size=9214
2026-01-12 22:10:36.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227036&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:10:44.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768227043 status=200 resp_size=6491
2026-01-12 22:10:45.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227044&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:10:48.242 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128290?api_key=51job&timestamp=1768227047 status=200 resp_size=10186
2026-01-12 22:10:48.462 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227048&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:10:51.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768227050 status=200 resp_size=7105
2026-01-12 22:10:51.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227051&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 22:11:01.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768227060 status=200 resp_size=9049
2026-01-12 22:11:01.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227061&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7521
2026-01-12 22:11:05.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768227065 status=200 resp_size=6788
2026-01-12 22:11:05.478 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227065&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:11:08.094 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169604659?api_key=51job&timestamp=1768227067 status=200 resp_size=7166
2026-01-12 22:11:08.333 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227068&companyId=2016195&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4559
2026-01-12 22:11:13.423 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170017735?api_key=51job&timestamp=1768227073 status=200 resp_size=6257
2026-01-12 22:11:13.643 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227073&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:11:16.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768227075 status=200 resp_size=6591
2026-01-12 22:11:16.310 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227076&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 22:11:26.475 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768227085 status=200 resp_size=5439
2026-01-12 22:11:26.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227086&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:11:26.705 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 22:11:26.766 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:11:26.767 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 22:11:27.860 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.09 秒后继续...
2026-01-12 22:11:27.860 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-12 22:11:27.860 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:11:27.883 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:11:32.290 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:33.513 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:36.333 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:36.333 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:11:37.787 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227087 status=200 resp_size=161750
2026-01-12 22:11:37.788 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:11:39.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768227097 status=200 resp_size=6749
2026-01-12 22:11:39.764 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227099&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 22:11:47.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169927328?api_key=51job&timestamp=1768227103 status=200 resp_size=9189
2026-01-12 22:11:47.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227107&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:11:48.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768227108 status=200 resp_size=5735
2026-01-12 22:11:49.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227108&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:11:56.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768227115 status=200 resp_size=5709
2026-01-12 22:11:56.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227116&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:12:13.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768227126 status=200 resp_size=5262
2026-01-12 22:12:14.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227133&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12331
2026-01-12 22:12:25.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768227142 status=200 resp_size=6074
2026-01-12 22:12:27.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227145&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 22:12:29.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167516?api_key=51job&timestamp=1768227149 status=200 resp_size=6493
2026-01-12 22:12:30.056 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227149&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:12:39.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768227158 status=200 resp_size=7002
2026-01-12 22:12:39.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227159&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:12:46.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170018599?api_key=51job&timestamp=1768227166 status=200 resp_size=6937
2026-01-12 22:12:47.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227166&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 22:12:55.485 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66521396?api_key=51job&timestamp=1768227174 status=200 resp_size=6694
2026-01-12 22:12:55.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227175&companyId=3220556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5999
2026-01-12 22:13:05.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169860176?api_key=51job&timestamp=1768227184 status=200 resp_size=6598
2026-01-12 22:13:05.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227185&companyId=1128753&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9600
2026-01-12 22:13:11.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768227191 status=200 resp_size=6570
2026-01-12 22:13:12.134 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227191&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:16.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259937?api_key=51job&timestamp=1768227195 status=200 resp_size=5729
2026-01-12 22:13:16.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227196&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 22:13:19.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768227198 status=200 resp_size=7569
2026-01-12 22:13:19.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227199&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-12 22:13:28.178 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129464?api_key=51job&timestamp=1768227205 status=200 resp_size=8602
2026-01-12 22:13:28.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227208&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:13:31.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768227211 status=200 resp_size=5519
2026-01-12 22:13:32.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227211&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:34.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168488694?api_key=51job&timestamp=1768227214 status=200 resp_size=6853
2026-01-12 22:13:34.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227214&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 22:13:42.126 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768227221 status=200 resp_size=5916
2026-01-12 22:13:42.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227222&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 22:13:52.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768227231 status=200 resp_size=7778
2026-01-12 22:13:52.471 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227232&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-12 22:13:56.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768227235 status=200 resp_size=6707
2026-01-12 22:13:56.258 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227236&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:56.258 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 20
2026-01-12 22:13:56.339 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:13:56.339 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-12 22:14:02.058 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.72 秒后继续...
2026-01-12 22:14:02.058 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-12 22:14:02.059 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:14:02.081 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:14:02.621 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:03.757 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:05.883 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:05.883 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:14:06.694 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227242 status=200 resp_size=150170
2026-01-12 22:14:06.694 | WARNING | __main__:get_recommend_jobs:745 - 第 7 页发现 1 个重复职位（已跳过）
2026-01-12 22:14:06.694 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:14:06.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768227246 status=200 resp_size=7212
2026-01-12 22:14:07.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227246&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-12 22:14:11.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129002?api_key=51job&timestamp=1768227250 status=200 resp_size=9018
2026-01-12 22:14:11.312 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227251&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:14:15.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376468?api_key=51job&timestamp=1768227255 status=200 resp_size=6732
2026-01-12 22:14:15.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227255&companyId=2297693&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10416
2026-01-12 22:14:19.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768227259 status=200 resp_size=6302
2026-01-12 22:14:19.632 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227259&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:14:23.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169414013?api_key=51job&timestamp=1768227263 status=200 resp_size=10496
2026-01-12 22:14:23.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227263&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:14:26.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168361598?api_key=51job&timestamp=1768227266 status=200 resp_size=5980
2026-01-12 22:14:26.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227266&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 22:14:30.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768227270 status=200 resp_size=8250
2026-01-12 22:14:30.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227270&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 22:14:32.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768227272 status=200 resp_size=6276
2026-01-12 22:14:32.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227272&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:14:35.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768227275 status=200 resp_size=7515
2026-01-12 22:14:35.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227275&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 22:14:43.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768227283 status=200 resp_size=5621
2026-01-12 22:14:44.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227283&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:14:49.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768227288 status=200 resp_size=6730
2026-01-12 22:14:49.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227289&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:14:54.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768227294 status=200 resp_size=8830
2026-01-12 22:14:54.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227294&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:15:02.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768227301 status=200 resp_size=6198
2026-01-12 22:15:02.414 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227302&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-12 22:15:08.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768227307 status=200 resp_size=5683
2026-01-12 22:15:08.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227308&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-12 22:15:13.942 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768227313 status=200 resp_size=5146
2026-01-12 22:15:14.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227313&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 22:15:22.446 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169917574?api_key=51job&timestamp=1768227321 status=200 resp_size=6563
2026-01-12 22:15:22.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227322&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:15:29.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768227328 status=200 resp_size=8382
2026-01-12 22:15:29.649 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227329&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 22:15:35.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768227334 status=200 resp_size=7332
2026-01-12 22:15:36.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227335&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10582
2026-01-12 22:15:46.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768227345 status=200 resp_size=5924
2026-01-12 22:15:46.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227346&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-12 22:15:46.722 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据，包含详细信息的数据条数: 19
2026-01-12 22:15:46.785 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:15:46.786 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-12 22:15:51.389 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.60 秒后继续...
2026-01-12 22:15:51.389 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-12 22:15:51.389 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:15:51.415 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:15:51.937 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:53.054 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:55.173 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:55.173 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:15:55.589 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227351 status=200 resp_size=131424
2026-01-12 22:15:55.589 | WARNING | __main__:get_recommend_jobs:745 - 第 8 页发现 2 个重复职位（已跳过）
2026-01-12 22:15:55.589 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:15:55.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768227355 status=200 resp_size=6463
2026-01-12 22:15:55.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227355&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:01.933 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948611?api_key=51job&timestamp=1768227361 status=200 resp_size=6442
2026-01-12 22:16:02.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227361&companyId=7226894&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6269
2026-01-12 22:16:06.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768227365 status=200 resp_size=6037
2026-01-12 22:16:06.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227366&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-12 22:16:10.630 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768227370 status=200 resp_size=5017
2026-01-12 22:16:11.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227370&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:14.811 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768227374 status=200 resp_size=5946
2026-01-12 22:16:15.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227374&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-12 22:16:22.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768227381 status=200 resp_size=5119
2026-01-12 22:16:23.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227382&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 22:16:31.046 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168502014?api_key=51job&timestamp=1768227390 status=200 resp_size=5713
2026-01-12 22:16:31.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227391&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:16:37.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768227396 status=200 resp_size=6519
2026-01-12 22:16:38.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227397&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:46.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768227406 status=200 resp_size=7005
2026-01-12 22:16:47.089 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227406&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 22:16:50.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768227410 status=200 resp_size=5130
2026-01-12 22:16:50.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227410&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 22:16:54.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768227414 status=200 resp_size=7141
2026-01-12 22:16:54.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227414&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 22:16:56.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170124203?api_key=51job&timestamp=1768227415 status=200 resp_size=5686
2026-01-12 22:16:56.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227416&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:02.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768227421 status=200 resp_size=13124
2026-01-12 22:17:02.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227422&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 22:17:07.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768227427 status=200 resp_size=5761
2026-01-12 22:17:07.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227427&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-12 22:17:13.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634560?api_key=51job&timestamp=1768227433 status=200 resp_size=5800
2026-01-12 22:17:14.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227433&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 22:17:21.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768227440 status=200 resp_size=6519
2026-01-12 22:17:21.432 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:24.653 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170029379?api_key=51job&timestamp=1768227444 status=200 resp_size=10587
2026-01-12 22:17:25.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227444&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:17:27.184 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165412012?api_key=51job&timestamp=1768227446 status=200 resp_size=6777
2026-01-12 22:17:27.417 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227447&companyId=3733053&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11037
2026-01-12 22:17:27.418 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据，包含详细信息的数据条数: 18
2026-01-12 22:17:27.470 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:17:27.471 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-12 22:17:29.834 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.36 秒后继续...
2026-01-12 22:17:29.835 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-12 22:17:29.835 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:17:29.862 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:17:30.659 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:31.933 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:34.169 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:34.169 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:17:34.947 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227449 status=200 resp_size=137462
2026-01-12 22:17:34.948 | WARNING | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位（已跳过）
2026-01-12 22:17:34.948 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:17:35.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768227454 status=200 resp_size=8475
2026-01-12 22:17:35.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227455&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:39.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231199?api_key=51job&timestamp=1768227458 status=200 resp_size=4036
2026-01-12 22:17:39.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227459&companyId=10150101&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 22:17:47.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768227467 status=200 resp_size=6159
2026-01-12 22:17:48.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227467&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:50.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224996?api_key=51job&timestamp=1768227469 status=200 resp_size=4633
2026-01-12 22:17:50.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227470&companyId=10149556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2624
2026-01-12 22:17:59.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768227478 status=200 resp_size=7971
2026-01-12 22:17:59.457 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227479&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:18:01.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110949?api_key=51job&timestamp=1768227481 status=200 resp_size=6196
2026-01-12 22:18:01.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227481&companyId=10137280&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2743
2026-01-12 22:18:05.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100789?api_key=51job&timestamp=1768227485 status=200 resp_size=5700
2026-01-12 22:18:05.897 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227485&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:18:10.847 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166843455?api_key=51job&timestamp=1768227490 status=200 resp_size=9530
2026-01-12 22:18:11.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227490&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 22:18:13.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768227493 status=200 resp_size=6600
2026-01-12 22:18:13.384 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227493&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7910
2026-01-12 22:18:24.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768227503 status=200 resp_size=7308
2026-01-12 22:18:24.244 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227504&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-12 22:18:31.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169943708?api_key=51job&timestamp=1768227510 status=200 resp_size=5987
2026-01-12 22:18:31.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227511&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:18:41.385 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170142499?api_key=51job&timestamp=1768227520 status=200 resp_size=5260
2026-01-12 22:18:41.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227521&companyId=3863622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7117
2026-01-12 22:18:45.979 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935463?api_key=51job&timestamp=1768227525 status=200 resp_size=5415
2026-01-12 22:18:46.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227525&companyId=10093538&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3901
2026-01-12 22:18:49.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768227529 status=200 resp_size=5364
2026-01-12 22:18:49.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227529&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-12 22:18:56.499 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169046179?api_key=51job&timestamp=1768227535 status=200 resp_size=5674
2026-01-12 22:18:56.739 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227536&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:19:01.221 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768227540 status=200 resp_size=5450
2026-01-12 22:19:01.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227541&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 22:19:12.383 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768227551 status=200 resp_size=7217
2026-01-12 22:19:12.675 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227552&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:19:22.853 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169936726?api_key=51job&timestamp=1768227562 status=200 resp_size=6459
2026-01-12 22:19:23.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227562&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 22:19:25.822 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169034126?api_key=51job&timestamp=1768227565 status=200 resp_size=8159
2026-01-12 22:19:27.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227565&companyId=7642544&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6020
2026-01-12 22:19:27.068 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据，包含详细信息的数据条数: 19
2026-01-12 22:19:27.151 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:19:27.153 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-12 22:19:33.478 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.32 秒后继续...
2026-01-12 22:19:33.478 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-12 22:19:33.479 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:19:33.502 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:19:35.077 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:36.328 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:38.581 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:38.581 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:19:39.369 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227573 status=200 resp_size=161897
2026-01-12 22:19:39.369 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位（已跳过）
2026-01-12 22:19:39.370 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:19:39.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052041?api_key=51job&timestamp=1768227579 status=200 resp_size=7503
2026-01-12 22:19:39.857 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227579&companyId=3967456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11455
2026-01-12 22:19:42.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768227582 status=200 resp_size=9486
2026-01-12 22:19:42.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227582&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 22:19:48.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768227587 status=200 resp_size=5738
2026-01-12 22:19:49.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227588&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10659
2026-01-12 22:19:59.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088704?api_key=51job&timestamp=1768227597 status=200 resp_size=7953
2026-01-12 22:19:59.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227599&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:20:03.836 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768227603 status=200 resp_size=6706
2026-01-12 22:20:04.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227603&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-12 22:20:06.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768227606 status=200 resp_size=5284
2026-01-12 22:20:06.972 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227606&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 22:20:14.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158175505?api_key=51job&timestamp=1768227613 status=200 resp_size=7072
2026-01-12 22:20:15.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227614&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 22:20:17.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768227617 status=200 resp_size=6107
2026-01-12 22:20:17.530 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227617&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 22:20:25.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154053858?api_key=51job&timestamp=1768227624 status=200 resp_size=6883
2026-01-12 22:20:26.231 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227625&companyId=3396091&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8076
2026-01-12 22:20:32.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768227631 status=200 resp_size=4916
2026-01-12 22:20:32.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227632&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 22:20:38.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768227637 status=200 resp_size=6086
2026-01-12 22:20:39.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227638&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-12 22:20:42.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357292?api_key=51job&timestamp=1768227642 status=200 resp_size=6485
2026-01-12 22:20:42.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227642&companyId=2255809&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8112
2026-01-12 22:20:44.429 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768227644 status=200 resp_size=8321
2026-01-12 22:20:44.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227644&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-12 22:20:48.842 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768227648 status=200 resp_size=6842
2026-01-12 22:20:49.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227648&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-12 22:20:59.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140557776?api_key=51job&timestamp=1768227658 status=200 resp_size=5399
2026-01-12 22:20:59.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227659&companyId=2940827&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10918
2026-01-12 22:21:07.663 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768227666 status=200 resp_size=5996
2026-01-12 22:21:08.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227667&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:21:12.399 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165654123?api_key=51job&timestamp=1768227672 status=200 resp_size=6528
2026-01-12 22:21:12.688 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227672&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 22:21:16.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169128572?api_key=51job&timestamp=1768227676 status=200 resp_size=5337
2026-01-12 22:21:17.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227676&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 22:21:17.159 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据，包含详细信息的数据条数: 18
2026-01-12 22:21:17.225 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:21:17.226 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-12 22:21:22.110 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.88 秒后继续...
2026-01-12 22:21:22.110 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-12 22:21:22.111 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:21:22.134 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:21:23.298 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:24.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:26.558 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:26.558 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:21:27.035 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227682 status=200 resp_size=155084
2026-01-12 22:21:27.035 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 2 个重复职位（已跳过）
2026-01-12 22:21:27.035 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:21:27.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169756645?api_key=51job&timestamp=1768227687 status=200 resp_size=6367
2026-01-12 22:21:27.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227687&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 22:21:40.045 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768227697 status=200 resp_size=6242
2026-01-12 22:21:40.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227700&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:21:42.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153925506?api_key=51job&timestamp=1768227702 status=200 resp_size=5824
2026-01-12 22:21:43.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227702&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:21:54.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768227712 status=200 resp_size=6222
2026-01-12 22:21:55.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227714&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-12 22:22:01.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170115317?api_key=51job&timestamp=1768227720 status=200 resp_size=10976
2026-01-12 22:22:01.740 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227721&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:22:10.641 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166253577?api_key=51job&timestamp=1768227729 status=200 resp_size=6225
2026-01-12 22:22:10.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227730&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:22:14.458 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163530512?api_key=51job&timestamp=1768227734 status=200 resp_size=5240
2026-01-12 22:22:14.655 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227734&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:22:16.848 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768227736 status=200 resp_size=6198
2026-01-12 22:22:17.096 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227736&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 22:22:20.639 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768227740 status=200 resp_size=5688
2026-01-12 22:22:20.890 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227740&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:22:30.613 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768227748 status=200 resp_size=5669
2026-01-12 22:22:30.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227750&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-12 22:22:32.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768227752 status=200 resp_size=5893
2026-01-12 22:22:32.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227752&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5455
2026-01-12 22:22:37.067 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768227756 status=200 resp_size=6070
2026-01-12 22:22:37.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227757&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-12 22:22:41.163 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170233170?api_key=51job&timestamp=1768227760 status=200 resp_size=6532
2026-01-12 22:22:41.603 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227761&companyId=10150186&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6054
2026-01-12 22:22:45.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148568?api_key=51job&timestamp=1768227764 status=200 resp_size=9405
2026-01-12 22:22:45.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227765&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:22:47.204 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768227766 status=200 resp_size=6534
2026-01-12 22:22:47.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227767&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2860
2026-01-12 22:22:49.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134905?api_key=51job&timestamp=1768227768 status=200 resp_size=7369
2026-01-12 22:22:50.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227769&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 22:22:55.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768227774 status=200 resp_size=8723
2026-01-12 22:22:56.129 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227775&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-12 22:23:02.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169966668?api_key=51job&timestamp=1768227780 status=200 resp_size=9642
2026-01-12 22:23:03.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227782&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:23:03.692 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据，包含详细信息的数据条数: 18
2026-01-12 22:23:03.767 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:23:03.768 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-12 22:23:13.440 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.67 秒后继续...
2026-01-12 22:23:13.440 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-12 22:23:13.440 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:23:13.458 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:23:14.137 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:15.293 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:17.440 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:17.440 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:23:17.897 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227793 status=200 resp_size=127505
2026-01-12 22:23:17.898 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:23:18.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169651289?api_key=51job&timestamp=1768227797 status=200 resp_size=5902
2026-01-12 22:23:18.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227798&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 22:23:28.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768227804 status=200 resp_size=5719
2026-01-12 22:23:28.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227808&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7174
2026-01-12 22:23:33.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166552266?api_key=51job&timestamp=1768227812 status=200 resp_size=6216
2026-01-12 22:23:35.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227813&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 22:23:46.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768227825 status=200 resp_size=5810
2026-01-12 22:23:46.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227826&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:23:50.363 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768227830 status=200 resp_size=6885
2026-01-12 22:23:50.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227830&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:23:58.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/124654690?api_key=51job&timestamp=1768227837 status=200 resp_size=6256
2026-01-12 22:23:58.984 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227838&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:24:07.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768227846 status=200 resp_size=6178
2026-01-12 22:24:07.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227847&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:24:12.116 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768227851 status=200 resp_size=6174
2026-01-12 22:24:12.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227852&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:24:21.004 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768227860 status=200 resp_size=5396
2026-01-12 22:24:21.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227861&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-12 22:24:28.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768227867 status=200 resp_size=5177
2026-01-12 22:24:28.987 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227868&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-12 22:24:31.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768227871 status=200 resp_size=4984
2026-01-12 22:24:31.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227871&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:24:38.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768227878 status=200 resp_size=5398
2026-01-12 22:24:38.920 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227878&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-12 22:24:47.965 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768227887 status=200 resp_size=6568
2026-01-12 22:24:48.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227887&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:24:59.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768227898 status=200 resp_size=5736
2026-01-12 22:24:59.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227899&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-12 22:25:01.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768227901 status=200 resp_size=6933
2026-01-12 22:25:02.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227901&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 22:25:06.191 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768227905 status=200 resp_size=5294
2026-01-12 22:25:08.589 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227906&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-12 22:25:15.068 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768227914 status=200 resp_size=6296
2026-01-12 22:25:15.273 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227915&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:25:16.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768227916 status=200 resp_size=6599
2026-01-12 22:25:16.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227916&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-12 22:25:26.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768227925 status=200 resp_size=6085
2026-01-12 22:25:26.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227926&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:25:33.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768227931 status=200 resp_size=5014
2026-01-12 22:25:33.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227933&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-12 22:25:33.300 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据，包含详细信息的数据条数: 20
2026-01-12 22:25:33.360 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:25:33.360 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-12 22:25:37.220 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.86 秒后继续...
2026-01-12 22:25:37.220 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-12 22:25:37.220 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:25:37.239 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:25:38.312 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:39.540 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:41.793 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:41.794 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:25:42.291 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227937 status=200 resp_size=115468
2026-01-12 22:25:42.292 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:25:42.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768227942 status=200 resp_size=5352
2026-01-12 22:25:42.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227942&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 22:25:52.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768227951 status=200 resp_size=4913
2026-01-12 22:25:52.955 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227952&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 22:26:00.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768227960 status=200 resp_size=5283
2026-01-12 22:26:00.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227960&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 22:26:10.241 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768227968 status=200 resp_size=7224
2026-01-12 22:26:10.540 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227970&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 22:26:20.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768227977 status=200 resp_size=5700
2026-01-12 22:26:20.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227980&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:26:25.518 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768227984 status=200 resp_size=6948
2026-01-12 22:26:25.782 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227985&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:26:35.374 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768227994 status=200 resp_size=5584
2026-01-12 22:26:35.713 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227995&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:26:45.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768228004 status=200 resp_size=7138
2026-01-12 22:26:45.181 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228005&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:26:53.755 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768228012 status=200 resp_size=5280
2026-01-12 22:26:53.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228013&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 22:27:04.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768228023 status=200 resp_size=5070
2026-01-12 22:27:04.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228024&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-12 22:27:11.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768228030 status=200 resp_size=5389
2026-01-12 22:27:11.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228031&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:27:15.183 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768228034 status=200 resp_size=4877
2026-01-12 22:27:15.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228035&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:27:22.044 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768228041 status=200 resp_size=6774
2026-01-12 22:27:22.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228042&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:27:36.908 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768228049 status=200 resp_size=5312
2026-01-12 22:27:38.127 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228056&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 22:27:48.978 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768228067 status=200 resp_size=5772
2026-01-12 22:27:49.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228068&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:27:51.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768228070 status=200 resp_size=5471
2026-01-12 22:27:51.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228071&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:27:59.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768228078 status=200 resp_size=5516
2026-01-12 22:28:00.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228079&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 22:28:10.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768228089 status=200 resp_size=4791
2026-01-12 22:28:10.412 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228090&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:28:15.188 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768228094 status=200 resp_size=6762
2026-01-12 22:28:15.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228095&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:28:21.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768228100 status=200 resp_size=5183
2026-01-12 22:28:22.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228101&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:28:22.153 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据，包含详细信息的数据条数: 20
2026-01-12 22:28:22.198 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:28:22.199 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-12 22:28:30.409 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.21 秒后继续...
2026-01-12 22:28:30.410 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-12 22:28:30.410 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:28:30.433 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:28:31.267 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:32.438 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:34.645 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:34.645 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:28:35.327 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228110 status=200 resp_size=156789
2026-01-12 22:28:35.328 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:28:35.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768228115 status=200 resp_size=5280
2026-01-12 22:28:35.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228115&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-12 22:28:46.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768228125 status=200 resp_size=5892
2026-01-12 22:28:46.548 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228126&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:28:53.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768228133 status=200 resp_size=7110
2026-01-12 22:28:54.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228133&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 22:28:56.762 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768228136 status=200 resp_size=7708
2026-01-12 22:28:56.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228136&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 22:29:00.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768228140 status=200 resp_size=6340
2026-01-12 22:29:00.480 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228140&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:29:08.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768228147 status=200 resp_size=4808
2026-01-12 22:29:09.052 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228148&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-12 22:29:20.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768228157 status=200 resp_size=9126
2026-01-12 22:29:21.138 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228160&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-12 22:29:27.805 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154072?api_key=51job&timestamp=1768228166 status=200 resp_size=5843
2026-01-12 22:29:27.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228167&companyId=10105052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2583
2026-01-12 22:29:37.192 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768228176 status=200 resp_size=5259
2026-01-12 22:29:37.415 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228177&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-12 22:29:40.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768228180 status=200 resp_size=5703
2026-01-12 22:29:40.989 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228180&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7408
2026-01-12 22:29:51.444 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147062300?api_key=51job&timestamp=1768228190 status=200 resp_size=7067
2026-01-12 22:29:51.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228191&companyId=2859609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5470
2026-01-12 22:29:59.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138538822?api_key=51job&timestamp=1768228198 status=200 resp_size=7613
2026-01-12 22:29:59.943 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228199&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 22:30:04.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768228204 status=200 resp_size=7276
2026-01-12 22:30:05.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228204&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 22:30:13.421 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170005961?api_key=51job&timestamp=1768228212 status=200 resp_size=6791
2026-01-12 22:30:13.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228213&companyId=6410180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5579
2026-01-12 22:30:15.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768228214 status=200 resp_size=6941
2026-01-12 22:30:15.608 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228215&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-12 22:30:21.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150106642?api_key=51job&timestamp=1768228220 status=200 resp_size=6557
2026-01-12 22:30:21.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228221&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 22:30:26.714 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768228226 status=200 resp_size=6562
2026-01-12 22:30:26.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228226&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-12 22:30:37.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768228236 status=200 resp_size=6602
2026-01-12 22:30:37.516 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228237&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-12 22:30:45.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231674?api_key=51job&timestamp=1768228245 status=200 resp_size=5777
2026-01-12 22:30:45.992 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228245&companyId=6817482&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9941
2026-01-12 22:30:53.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634483?api_key=51job&timestamp=1768228252 status=200 resp_size=6141
2026-01-12 22:30:53.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228253&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 22:30:53.928 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据，包含详细信息的数据条数: 20
2026-01-12 22:31:10.167 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:31:10.167 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-12 22:31:17.828 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.66 秒后继续...
2026-01-12 22:31:17.829 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-12 22:31:17.829 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:31:17.849 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:31:18.791 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:20.019 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:22.186 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:22.186 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:31:22.741 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228277 status=200 resp_size=158428
2026-01-12 22:31:22.744 | WARNING | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位（已跳过）
2026-01-12 22:31:22.744 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:31:22.954 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768228282 status=200 resp_size=8778
2026-01-12 22:31:23.194 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228282&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 22:31:32.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768228291 status=200 resp_size=6727
2026-01-12 22:31:32.718 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228292&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14378
2026-01-12 22:31:42.393 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768228301 status=200 resp_size=8678
2026-01-12 22:31:42.568 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228302&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-12 22:31:50.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817474?api_key=51job&timestamp=1768228309 status=200 resp_size=6345
2026-01-12 22:31:50.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228310&companyId=2545142&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10393
2026-01-12 22:31:53.809 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768228313 status=200 resp_size=7930
2026-01-12 22:31:54.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228313&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 22:32:01.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768228320 status=200 resp_size=6531
2026-01-12 22:32:01.768 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228321&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-12 22:32:03.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768228323 status=200 resp_size=5922
2026-01-12 22:32:04.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228323&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-12 22:32:14.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768228333 status=200 resp_size=6743
2026-01-12 22:32:14.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228334&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 22:32:25.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768228342 status=200 resp_size=6723
2026-01-12 22:32:25.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228345&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:32:28.024 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768228347 status=200 resp_size=6707
2026-01-12 22:32:28.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228348&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-12 22:32:32.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768228351 status=200 resp_size=5182
2026-01-12 22:32:32.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228352&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-12 22:32:40.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768228360 status=200 resp_size=7336
2026-01-12 22:32:41.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228360&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 22:32:46.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164447837?api_key=51job&timestamp=1768228366 status=200 resp_size=6464
2026-01-12 22:32:47.062 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228366&companyId=2011241&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7326
2026-01-12 22:32:54.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169628292?api_key=51job&timestamp=1768228372 status=200 resp_size=9292
2026-01-12 22:32:54.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228374&companyId=8488343&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6172
2026-01-12 22:32:56.250 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768228375 status=200 resp_size=7408
2026-01-12 22:32:56.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228376&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:32:59.010 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768228378 status=200 resp_size=5204
2026-01-12 22:32:59.867 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228379&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-12 22:33:10.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169233720?api_key=51job&timestamp=1768228389 status=200 resp_size=11982
2026-01-12 22:33:10.624 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228390&companyId=2911011&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7823
2026-01-12 22:33:14.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768228394 status=200 resp_size=6382
2026-01-12 22:33:14.708 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228394&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 22:33:23.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768228403 status=200 resp_size=6287
2026-01-12 22:33:24.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228403&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-12 22:33:24.131 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据，包含详细信息的数据条数: 19
2026-01-12 22:33:24.217 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:33:24.218 | INFO | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-12 22:33:31.748 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.53 秒后继续...
2026-01-12 22:33:31.748 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 16/26 页...
2026-01-12 22:33:31.748 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:33:31.768 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:33:32.736 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:33.952 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:36.213 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:36.213 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:33:36.780 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228411 status=200 resp_size=132983
2026-01-12 22:33:36.781 | WARNING | __main__:get_recommend_jobs:745 - 第 16 页发现 2 个重复职位（已跳过）
2026-01-12 22:33:36.781 | INFO | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:33:37.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170222457?api_key=51job&timestamp=1768228416 status=200 resp_size=5811
2026-01-12 22:33:37.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228417&companyId=2935467&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4653
2026-01-12 22:33:44.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768228423 status=200 resp_size=5720
2026-01-12 22:33:44.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228424&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-12 22:33:52.817 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768228431 status=200 resp_size=4956
2026-01-12 22:33:53.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228432&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-12 22:33:59.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768228438 status=200 resp_size=4906
2026-01-12 22:33:59.561 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228439&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:34:06.801 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768228445 status=200 resp_size=4844
2026-01-12 22:34:07.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228446&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:34:15.170 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768228454 status=200 resp_size=6279
2026-01-12 22:34:15.738 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228455&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-12 22:34:23.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768228461 status=200 resp_size=5036
2026-01-12 22:34:23.419 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228463&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-12 22:34:28.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170103322?api_key=51job&timestamp=1768228467 status=200 resp_size=6072
2026-01-12 22:34:28.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228468&companyId=4247478&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9392
2026-01-12 22:34:35.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768228474 status=200 resp_size=7334
2026-01-12 22:34:35.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228475&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:34:39.293 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768228479 status=200 resp_size=4996
2026-01-12 22:34:39.484 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228479&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:34:42.107 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768228481 status=200 resp_size=6337
2026-01-12 22:34:42.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228482&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-12 22:34:43.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768228483 status=200 resp_size=5328
2026-01-12 22:34:43.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228483&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-12 22:34:50.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768228489 status=200 resp_size=5666
2026-01-12 22:34:50.453 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228490&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:34:59.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768228498 status=200 resp_size=6738
2026-01-12 22:34:59.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228499&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:35:05.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768228504 status=200 resp_size=6027
2026-01-12 22:35:05.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228505&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-12 22:35:14.029 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768228512 status=200 resp_size=5743
2026-01-12 22:35:14.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228514&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-12 22:35:24.558 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768228523 status=200 resp_size=4786
2026-01-12 22:35:24.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228524&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:35:33.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768228531 status=200 resp_size=6289
2026-01-12 22:35:33.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228533&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-12 22:35:33.636 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据，包含详细信息的数据条数: 18
2026-01-12 22:35:33.681 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:35:33.683 | INFO | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-12 22:35:38.588 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.90 秒后继续...
2026-01-12 22:35:38.588 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 17/26 页...
2026-01-12 22:35:38.588 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:35:38.608 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:35:39.402 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:40.628 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:42.812 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:42.812 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:35:43.342 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228538 status=200 resp_size=135353
2026-01-12 22:35:43.342 | INFO | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:35:43.598 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170014244?api_key=51job&timestamp=1768228543 status=200 resp_size=4917
2026-01-12 22:35:43.814 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228543&companyId=8807926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5654
2026-01-12 22:35:46.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188854?api_key=51job&timestamp=1768228546 status=200 resp_size=4845
2026-01-12 22:35:46.877 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228546&companyId=7206810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4861
2026-01-12 22:35:54.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170119049?api_key=51job&timestamp=1768228553 status=200 resp_size=8496
2026-01-12 22:35:54.900 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228554&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:36:04.508 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768228562 status=200 resp_size=4945
2026-01-12 22:36:04.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228564&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:36:14.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768228573 status=200 resp_size=5760
2026-01-12 22:36:14.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228574&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:36:25.182 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768228584 status=200 resp_size=5933
2026-01-12 22:36:25.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228585&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-12 22:36:31.079 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768228590 status=200 resp_size=7216
2026-01-12 22:36:31.240 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228591&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:36:37.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169892108?api_key=51job&timestamp=1768228596 status=200 resp_size=5148
2026-01-12 22:36:37.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228597&companyId=10115925&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2772
2026-01-12 22:36:43.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768228602 status=200 resp_size=5991
2026-01-12 22:36:43.501 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228603&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-12 22:36:54.124 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170055934?api_key=51job&timestamp=1768228613 status=200 resp_size=7479
2026-01-12 22:36:54.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228614&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:37:05.760 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169317263?api_key=51job&timestamp=1768228624 status=200 resp_size=5951
2026-01-12 22:37:05.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228625&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:37:08.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768228628 status=200 resp_size=4719
2026-01-12 22:37:09.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228628&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-12 22:37:14.915 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168803406?api_key=51job&timestamp=1768228634 status=200 resp_size=7719
2026-01-12 22:37:15.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228634&companyId=2055954&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10253
2026-01-12 22:37:24.514 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768228643 status=200 resp_size=6381
2026-01-12 22:37:24.769 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228644&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-12 22:37:26.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768228646 status=200 resp_size=4654
2026-01-12 22:37:26.664 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228646&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-12 22:37:36.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768228656 status=200 resp_size=5328
2026-01-12 22:37:37.057 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228656&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-12 22:37:39.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768228658 status=200 resp_size=4709
2026-01-12 22:37:39.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228659&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 22:37:43.408 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768228663 status=200 resp_size=4743
2026-01-12 22:37:43.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228663&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:37:50.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768228669 status=200 resp_size=4761
2026-01-12 22:37:52.003 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228670&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:38:01.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768228681 status=200 resp_size=6331
2026-01-12 22:38:01.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228681&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:38:01.910 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据，包含详细信息的数据条数: 20
2026-01-12 22:38:01.940 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:38:01.941 | INFO | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-12 22:38:05.247 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.31 秒后继续...
2026-01-12 22:38:05.247 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 18/26 页...
2026-01-12 22:38:05.248 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:38:05.268 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:38:06.028 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:07.264 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:09.397 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:09.398 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:38:09.874 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228685 status=200 resp_size=129209
2026-01-12 22:38:09.874 | INFO | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:38:10.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768228689 status=200 resp_size=5352
2026-01-12 22:38:10.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228690&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 22:38:18.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768228697 status=200 resp_size=5262
2026-01-12 22:38:19.020 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228698&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-12 22:38:20.325 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768228700 status=200 resp_size=4534
2026-01-12 22:38:20.575 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228700&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-12 22:38:29.858 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768228709 status=200 resp_size=6046
2026-01-12 22:38:30.149 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228709&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-12 22:38:36.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768228715 status=200 resp_size=5889
2026-01-12 22:38:36.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228716&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-12 22:38:38.505 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768228718 status=200 resp_size=5300
2026-01-12 22:38:38.808 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228718&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:38:47.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768228726 status=200 resp_size=7337
2026-01-12 22:38:47.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228727&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 22:38:52.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768228731 status=200 resp_size=7788
2026-01-12 22:38:52.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228732&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-12 22:38:55.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768228735 status=200 resp_size=6317
2026-01-12 22:38:55.599 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228735&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-12 22:38:58.670 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169110406?api_key=51job&timestamp=1768228738 status=200 resp_size=5478
2026-01-12 22:38:58.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228738&companyId=2660745&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6602
2026-01-12 22:39:08.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768228747 status=200 resp_size=5545
2026-01-12 22:39:08.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228748&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:18.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768228757 status=200 resp_size=5252
2026-01-12 22:39:18.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228758&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:24.150 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768228763 status=200 resp_size=5883
2026-01-12 22:39:24.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228764&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7753
2026-01-12 22:39:35.049 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768228771 status=200 resp_size=5496
2026-01-12 22:39:35.534 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228775&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-12 22:39:44.535 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768228783 status=200 resp_size=5626
2026-01-12 22:39:44.852 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228784&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:53.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768228792 status=200 resp_size=5496
2026-01-12 22:39:53.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228793&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7753
2026-01-12 22:40:01.047 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768228800 status=200 resp_size=6572
2026-01-12 22:40:01.235 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228801&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-12 22:40:04.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768228803 status=200 resp_size=5692
2026-01-12 22:40:04.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228804&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:40:09.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768228809 status=200 resp_size=5476
2026-01-12 22:40:09.430 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228809&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:40:13.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768228813 status=200 resp_size=4874
2026-01-12 22:40:13.816 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228813&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:40:13.816 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据，包含详细信息的数据条数: 20
2026-01-12 22:40:30.077 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:40:30.077 | INFO | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-12 22:40:34.353 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 4.27 秒后继续...
2026-01-12 22:40:34.353 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 19/26 页...
2026-01-12 22:40:34.353 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:40:34.375 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:40:34.963 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:36.094 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:38.377 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:38.377 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:40:39.138 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228834 status=200 resp_size=123428
2026-01-12 22:40:39.138 | INFO | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:40:39.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768228839 status=200 resp_size=5276
2026-01-12 22:40:40.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228839&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:40:43.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768228843 status=200 resp_size=4507
2026-01-12 22:40:44.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228843&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-12 22:40:48.994 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167326217?api_key=51job&timestamp=1768228848 status=200 resp_size=5446
2026-01-12 22:40:49.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228848&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:40:57.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768228856 status=200 resp_size=4798
2026-01-12 22:40:57.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228857&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-12 22:41:01.347 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768228861 status=200 resp_size=5244
2026-01-12 22:41:01.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228861&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:41:11.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768228870 status=200 resp_size=5511
2026-01-12 22:41:12.105 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228871&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-12 22:41:13.422 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768228873 status=200 resp_size=5241
2026-01-12 22:41:13.633 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228873&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:41:21.400 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768228880 status=200 resp_size=6484
2026-01-12 22:41:21.556 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228881&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:41:26.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768228885 status=200 resp_size=8628
2026-01-12 22:41:26.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228886&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-12 22:41:33.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768228893 status=200 resp_size=8470
2026-01-12 22:41:34.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228893&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7583
2026-01-12 22:41:38.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768228897 status=200 resp_size=6113
2026-01-12 22:41:38.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228898&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:41:47.084 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768228906 status=200 resp_size=6555
2026-01-12 22:41:47.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228907&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:41:53.571 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768228912 status=200 resp_size=6074
2026-01-12 22:41:53.731 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228913&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-12 22:41:58.553 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768228918 status=200 resp_size=5714
2026-01-12 22:41:58.697 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228918&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-12 22:42:08.011 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768228926 status=200 resp_size=6131
2026-01-12 22:42:08.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228928&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:42:16.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768228935 status=200 resp_size=5846
2026-01-12 22:42:16.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228936&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:42:20.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768228938 status=200 resp_size=5515
2026-01-12 22:42:20.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228940&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-12 22:42:28.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768228947 status=200 resp_size=5875
2026-01-12 22:42:28.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228948&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:42:33.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768228953 status=200 resp_size=6168
2026-01-12 22:42:33.537 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228953&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 22:42:43.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768228962 status=200 resp_size=5605
2026-01-12 22:42:43.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228963&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-12 22:42:43.745 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据，包含详细信息的数据条数: 20
2026-01-12 22:43:00.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:43:00.036 | INFO | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-12 22:43:06.861 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.82 秒后继续...
2026-01-12 22:43:06.862 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 20/26 页...
2026-01-12 22:43:06.862 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:43:06.884 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:43:07.442 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:08.562 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:10.690 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:10.690 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:43:11.072 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228986 status=200 resp_size=111806
2026-01-12 22:43:11.073 | INFO | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:43:11.276 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170225792?api_key=51job&timestamp=1768228991 status=200 resp_size=5831
2026-01-12 22:43:11.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228991&companyId=10080902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2578
2026-01-12 22:43:19.687 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768228998 status=200 resp_size=5658
2026-01-12 22:43:19.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228999&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-12 22:43:27.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768229006 status=200 resp_size=6135
2026-01-12 22:43:27.952 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229007&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:43:31.773 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768229011 status=200 resp_size=6256
2026-01-12 22:43:31.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229011&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-12 22:43:34.876 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768229014 status=200 resp_size=5423
2026-01-12 22:43:35.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229014&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 22:43:45.597 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768229024 status=200 resp_size=5470
2026-01-12 22:43:45.892 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229025&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-12 22:43:51.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768229030 status=200 resp_size=6130
2026-01-12 22:43:51.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229031&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:43:55.737 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768229035 status=200 resp_size=5876
2026-01-12 22:43:55.938 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229035&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:43:59.522 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768229039 status=200 resp_size=4643
2026-01-12 22:43:59.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229039&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:44:03.111 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768229042 status=200 resp_size=6103
2026-01-12 22:44:03.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229043&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:44:08.131 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768229047 status=200 resp_size=6341
2026-01-12 22:44:08.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229048&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-12 22:44:16.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768229055 status=200 resp_size=6443
2026-01-12 22:44:16.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229056&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-12 22:44:19.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768229059 status=200 resp_size=5316
2026-01-12 22:44:19.911 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229059&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:44:28.707 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768229067 status=200 resp_size=5998
2026-01-12 22:44:29.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229068&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:44:38.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768229077 status=200 resp_size=6502
2026-01-12 22:44:38.527 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229078&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 22:44:45.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768229084 status=200 resp_size=6137
2026-01-12 22:44:45.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229085&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:44:48.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768229088 status=200 resp_size=6214
2026-01-12 22:44:48.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229088&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 22:44:57.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768229095 status=200 resp_size=6091
2026-01-12 22:44:57.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229097&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:45:07.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768229106 status=200 resp_size=5556
2026-01-12 22:45:07.719 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229107&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 22:45:10.387 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768229110 status=200 resp_size=6839
2026-01-12 22:45:10.686 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229110&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 22:45:10.686 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据，包含详细信息的数据条数: 20
2026-01-12 22:45:10.771 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:45:10.771 | INFO | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-12 22:45:17.212 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.44 秒后继续...
2026-01-12 22:45:17.212 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 21/26 页...
2026-01-12 22:45:17.212 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:45:17.250 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:45:17.931 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:19.116 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:21.276 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:21.276 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:45:21.721 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229117 status=200 resp_size=110536
2026-01-12 22:45:21.722 | INFO | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:45:21.974 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768229121 status=200 resp_size=5831
2026-01-12 22:45:22.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229121&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-12 22:45:29.269 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768229128 status=200 resp_size=7006
2026-01-12 22:45:29.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229129&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-12 22:45:40.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768229139 status=200 resp_size=5438
2026-01-12 22:45:40.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229140&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:45:48.767 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768229147 status=200 resp_size=6095
2026-01-12 22:45:49.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229148&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 22:45:51.763 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768229151 status=200 resp_size=5318
2026-01-12 22:45:52.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229151&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:45:53.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768229153 status=200 resp_size=5562
2026-01-12 22:45:54.109 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229153&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 22:46:04.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768229163 status=200 resp_size=6087
2026-01-12 22:46:04.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229164&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-12 22:46:14.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768229172 status=200 resp_size=6040
2026-01-12 22:46:15.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229174&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:46:22.583 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169257199?api_key=51job&timestamp=1768229181 status=200 resp_size=6221
2026-01-12 22:46:22.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229182&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 22:46:26.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768229185 status=200 resp_size=6466
2026-01-12 22:46:26.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229186&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:46:28.515 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768229188 status=200 resp_size=5408
2026-01-12 22:46:28.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229188&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 22:46:39.339 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768229198 status=200 resp_size=6137
2026-01-12 22:46:39.497 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229199&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:46:43.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768229203 status=200 resp_size=5663
2026-01-12 22:46:43.564 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229203&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-12 22:46:51.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768229210 status=200 resp_size=6320
2026-01-12 22:46:51.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229211&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-12 22:46:59.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768229218 status=200 resp_size=6475
2026-01-12 22:46:59.477 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229219&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-12 22:47:03.015 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768229222 status=200 resp_size=6131
2026-01-12 22:47:03.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229223&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:05.468 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768229225 status=200 resp_size=6348
2026-01-12 22:47:05.685 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229225&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-12 22:47:07.061 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768229226 status=200 resp_size=5427
2026-01-12 22:47:07.261 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229227&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 22:47:09.783 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768229229 status=200 resp_size=5329
2026-01-12 22:47:09.983 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229229&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:47:14.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768229234 status=200 resp_size=6137
2026-01-12 22:47:14.592 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229234&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:14.592 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据，包含详细信息的数据条数: 20
2026-01-12 22:47:14.630 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:47:14.631 | INFO | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-12 22:47:24.157 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.53 秒后继续...
2026-01-12 22:47:24.157 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 22/26 页...
2026-01-12 22:47:24.158 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:47:24.181 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:47:24.896 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:26.096 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:28.261 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:28.262 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:47:28.726 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229244 status=200 resp_size=122771
2026-01-12 22:47:28.726 | INFO | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:47:28.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768229248 status=200 resp_size=6858
2026-01-12 22:47:29.193 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229248&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:47:36.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768229255 status=200 resp_size=6006
2026-01-12 22:47:36.390 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229256&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-12 22:47:41.002 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170222163?api_key=51job&timestamp=1768229260 status=200 resp_size=6229
2026-01-12 22:47:41.206 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229261&companyId=10134628&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2816
2026-01-12 22:47:47.652 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768229266 status=200 resp_size=6131
2026-01-12 22:47:48.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229267&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:55.143 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768229273 status=200 resp_size=5692
2026-01-12 22:47:55.342 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229275&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 22:48:02.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768229280 status=200 resp_size=6164
2026-01-12 22:48:02.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229282&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-12 22:48:12.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768229291 status=200 resp_size=6114
2026-01-12 22:48:12.579 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229292&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:48:14.959 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768229294 status=200 resp_size=6133
2026-01-12 22:48:15.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229294&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:48:24.881 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768229303 status=200 resp_size=6249
2026-01-12 22:48:25.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229304&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-12 22:48:33.609 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768229312 status=200 resp_size=6045
2026-01-12 22:48:33.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229313&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-12 22:48:37.681 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768229317 status=200 resp_size=5697
2026-01-12 22:48:37.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229317&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:48:45.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768229325 status=200 resp_size=6162
2026-01-12 22:48:46.238 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229325&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:48:54.217 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768229333 status=200 resp_size=5879
2026-01-12 22:48:54.431 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229334&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:49:04.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768229343 status=200 resp_size=5350
2026-01-12 22:49:04.525 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229344&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:49:10.882 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768229350 status=200 resp_size=6118
2026-01-12 22:49:11.081 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229350&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:49:19.006 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768229358 status=200 resp_size=5192
2026-01-12 22:49:19.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229359&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-12 22:49:28.612 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768229367 status=200 resp_size=5859
2026-01-12 22:49:28.871 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229368&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:49:37.595 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768229376 status=200 resp_size=5600
2026-01-12 22:49:37.875 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229377&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:49:39.331 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768229379 status=200 resp_size=5106
2026-01-12 22:49:39.550 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229379&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-12 22:49:42.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768229382 status=200 resp_size=6429
2026-01-12 22:49:42.967 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229382&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:49:42.967 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据，包含详细信息的数据条数: 20
2026-01-12 22:49:43.062 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:49:43.062 | INFO | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-12 22:49:52.150 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.09 秒后继续...
2026-01-12 22:49:52.150 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 23/26 页...
2026-01-12 22:49:52.150 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:49:52.177 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:49:52.859 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:54.026 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:56.282 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:56.283 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:49:57.555 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229392 status=200 resp_size=136713
2026-01-12 22:49:57.555 | INFO | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:49:57.802 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768229397 status=200 resp_size=6053
2026-01-12 22:49:58.173 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229397&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 22:50:03.360 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768229403 status=200 resp_size=5403
2026-01-12 22:50:03.557 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229403&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:04.982 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169656442?api_key=51job&timestamp=1768229404 status=200 resp_size=4972
2026-01-12 22:50:05.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229404&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:14.823 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768229413 status=200 resp_size=6993
2026-01-12 22:50:15.185 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229414&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:50:19.220 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768229418 status=200 resp_size=7151
2026-01-12 22:50:19.533 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229419&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-12 22:50:21.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768229421 status=200 resp_size=5439
2026-01-12 22:50:21.883 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229421&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:23.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165495518?api_key=51job&timestamp=1768229423 status=200 resp_size=4861
2026-01-12 22:50:23.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229423&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:27.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768229427 status=200 resp_size=7109
2026-01-12 22:50:27.774 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229427&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:50:34.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768229433 status=200 resp_size=6535
2026-01-12 22:50:34.996 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229434&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-12 22:50:43.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768229442 status=200 resp_size=6351
2026-01-12 22:50:43.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229443&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:50.321 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768229449 status=200 resp_size=5747
2026-01-12 22:50:50.604 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229450&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:51.986 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768229451 status=200 resp_size=6278
2026-01-12 22:50:52.249 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229451&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-12 22:51:02.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170215196?api_key=51job&timestamp=1768229461 status=200 resp_size=5893
2026-01-12 22:51:03.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229462&companyId=3238676&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6838
2026-01-12 22:51:13.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768229472 status=200 resp_size=6548
2026-01-12 22:51:13.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229473&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:15.870 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768229475 status=200 resp_size=4871
2026-01-12 22:51:16.037 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229475&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:17.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768229477 status=200 resp_size=5159
2026-01-12 22:51:17.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229477&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:21.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768229480 status=200 resp_size=5080
2026-01-12 22:51:21.328 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229481&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:27.799 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768229487 status=200 resp_size=6104
2026-01-12 22:51:27.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229487&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:36.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768229495 status=200 resp_size=5130
2026-01-12 22:51:36.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229496&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:39.704 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768229499 status=200 resp_size=5503
2026-01-12 22:51:39.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229499&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:39.964 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据，包含详细信息的数据条数: 20
2026-01-12 22:51:40.035 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:51:40.035 | INFO | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-12 22:51:48.366 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.33 秒后继续...
2026-01-12 22:51:48.366 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 24/26 页...
2026-01-12 22:51:48.367 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:51:48.387 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:51:49.332 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:50.637 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:52.806 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:52.807 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:51:53.329 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229508 status=200 resp_size=129904
2026-01-12 22:51:53.330 | INFO | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:51:53.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768229513 status=200 resp_size=5106
2026-01-12 22:51:54.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229513&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7231
2026-01-12 22:52:03.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768229523 status=200 resp_size=5351
2026-01-12 22:52:04.168 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229523&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:06.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768229525 status=200 resp_size=4873
2026-01-12 22:52:06.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229526&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:52:08.379 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768229528 status=200 resp_size=7710
2026-01-12 22:52:08.572 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229528&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-12 22:52:18.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170228069?api_key=51job&timestamp=1768229537 status=200 resp_size=5016
2026-01-12 22:52:18.337 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229538&companyId=10149719&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2623
2026-01-12 22:52:23.420 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768229543 status=200 resp_size=5237
2026-01-12 22:52:23.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229543&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:33.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768229553 status=200 resp_size=5054
2026-01-12 22:52:34.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229553&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:52:41.536 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768229560 status=200 resp_size=7321
2026-01-12 22:52:41.706 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229561&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11118
2026-01-12 22:52:48.813 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170235125?api_key=51job&timestamp=1768229567 status=200 resp_size=4437
2026-01-12 22:52:49.233 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229568&companyId=10150403&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2584
2026-01-12 22:52:51.298 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768229570 status=200 resp_size=5203
2026-01-12 22:52:51.590 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229571&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:58.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768229577 status=200 resp_size=5212
2026-01-12 22:52:58.236 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229578&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:03.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768229583 status=200 resp_size=6980
2026-01-12 22:53:03.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229583&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-12 22:53:05.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238188?api_key=51job&timestamp=1768229585 status=200 resp_size=6819
2026-01-12 22:53:05.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229585&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:53:12.683 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768229591 status=200 resp_size=4883
2026-01-12 22:53:12.891 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229592&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:53:17.394 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768229597 status=200 resp_size=5582
2026-01-12 22:53:17.694 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229597&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:27.118 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768229606 status=200 resp_size=6900
2026-01-12 22:53:27.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229607&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-12 22:53:31.860 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768229611 status=200 resp_size=4989
2026-01-12 22:53:32.060 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229611&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-12 22:53:36.511 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768229616 status=200 resp_size=5218
2026-01-12 22:53:36.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229616&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:53:40.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768229619 status=200 resp_size=5166
2026-01-12 22:53:40.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229620&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:46.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238197?api_key=51job&timestamp=1768229625 status=200 resp_size=6533
2026-01-12 22:53:46.679 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229626&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:53:46.679 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据，包含详细信息的数据条数: 20
2026-01-12 22:53:46.749 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:53:46.749 | INFO | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-12 22:53:48.822 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.06 秒后继续...
2026-01-12 22:53:48.822 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 25/26 页...
2026-01-12 22:53:48.822 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:53:48.863 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:53:49.550 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:50.719 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:52.887 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:52.887 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:53:53.433 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229628 status=200 resp_size=137112
2026-01-12 22:53:53.433 | INFO | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:53:53.642 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768229633 status=200 resp_size=5146
2026-01-12 22:53:53.835 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229633&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-12 22:54:02.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768229641 status=200 resp_size=5063
2026-01-12 22:54:02.985 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229642&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-12 22:54:13.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768229652 status=200 resp_size=5313
2026-01-12 22:54:13.352 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229653&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:22.388 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238151?api_key=51job&timestamp=1768229661 status=200 resp_size=6455
2026-01-12 22:54:22.656 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229662&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:54:24.807 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768229664 status=200 resp_size=8614
2026-01-12 22:54:25.043 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229664&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14621
2026-01-12 22:54:31.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768229670 status=200 resp_size=5160
2026-01-12 22:54:32.069 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229671&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:33.486 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157363847?api_key=51job&timestamp=1768229673 status=200 resp_size=6228
2026-01-12 22:54:33.736 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229673&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:54:38.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768229678 status=200 resp_size=4992
2026-01-12 22:54:39.139 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229678&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:54:43.626 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768229683 status=200 resp_size=5107
2026-01-12 22:54:43.901 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229683&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:47.326 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768229687 status=200 resp_size=6652
2026-01-12 22:54:47.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229687&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-12 22:54:55.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768229694 status=200 resp_size=7080
2026-01-12 22:54:55.640 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229695&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-12 22:55:05.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768229704 status=200 resp_size=5002
2026-01-12 22:55:05.454 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229705&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:55:13.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768229712 status=200 resp_size=4745
2026-01-12 22:55:13.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229713&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-12 22:55:22.025 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768229721 status=200 resp_size=10685
2026-01-12 22:55:22.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229722&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 22:55:31.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768229730 status=200 resp_size=6536
2026-01-12 22:55:32.080 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229731&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-12 22:55:41.587 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768229740 status=200 resp_size=4889
2026-01-12 22:55:41.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229741&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:55:52.174 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768229751 status=200 resp_size=5460
2026-01-12 22:55:52.373 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229752&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:55:55.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768229755 status=200 resp_size=5069
2026-01-12 22:55:55.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229755&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-12 22:56:01.340 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768229760 status=200 resp_size=4315
2026-01-12 22:56:01.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229761&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-12 22:56:04.554 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768229764 status=200 resp_size=4912
2026-01-12 22:56:04.723 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229764&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:56:04.723 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据，包含详细信息的数据条数: 20
2026-01-12 22:56:12.952 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:56:12.957 | INFO | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-12 22:56:16.407 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.45 秒后继续...
2026-01-12 22:56:16.407 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 26/26 页...
2026-01-12 22:56:16.409 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:16.485 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:56:17.168 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:18.338 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:20.506 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:20.506 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:56:20.902 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229776 status=200 resp_size=9174
2026-01-12 22:56:20.902 | INFO | __main__:get_recommend_jobs:747 - 第 26 页成功获取 1 个职位（去重后: 1） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:56:21.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768229780 status=200 resp_size=5936
2026-01-12 22:56:21.306 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229781&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:56:21.306 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据，包含详细信息的数据条数: 1
2026-01-12 22:56:21.346 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 1, 响应大小: 112 字节
2026-01-12 22:56:21.346 | INFO | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 1 个职位 | 累计: 501 个
2026-01-12 22:56:21.346 | INFO | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (501/501)，提前结束爬取
2026-01-12 22:56:21.347 | INFO | __main__:crawl_multiple_pages:1056 -
================================================================================
2026-01-12 22:56:21.347 | INFO | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 22:56:21.347 | INFO | __main__:crawl_multiple_pages:1058 - 总抓取数量: 501 条
2026-01-12 22:56:21.347 | INFO | __main__:crawl_multiple_pages:1059 - 去重后数量: 490 条
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1060 - 重复数量: 11 条
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1061 - API返回totalCount: 501 条
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1062 - 实际爬取页数: 26 页
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1063 - 地区: 河源(32100)
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1064 - 职能: 高级硬件工程师(2956)
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1067 - 覆盖率: 97.80% (490/501)
2026-01-12 22:56:21.348 | WARNING | __main__:crawl_multiple_pages:1069 - 注意: 实际抓取数量(490) < API返回总数(501)，可能存在分页问题或数据过滤
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1072 - ================================================================================
2026-01-12 22:56:21.348 | INFO | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 22:56:21.348 | INFO | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 490 条记录)
2026-01-12 22:56:21.348 | INFO | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 490 个职位
2026-01-12 22:56:21.350 | INFO | __main__:close:1137 - httpx客户端已关闭
2026-01-12 22:56:25.202 | INFO | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.220 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.296 | INFO | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 义乌 (81400)
2026-01-12 22:56:25.296 | INFO | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 夹具工程师 (0565)
2026-01-12 22:56:25.296 | INFO | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 22:56:25.296 | INFO | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 22:56:25.301 | INFO | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:56:25.301 | INFO | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 22:56:25.301 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 1/50 页...
2026-01-12 22:56:25.301 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.347 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 22:56:25.994 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:27.140 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:29.279 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:29.279 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:56:29.812 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229785 status=200 resp_size=120630
2026-01-12 22:56:29.817 | INFO | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:56:30.121 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768229789 status=200 resp_size=5965
2026-01-12 22:56:30.296 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229790&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:56:38.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768229797 status=200 resp_size=5589
2026-01-12 22:56:38.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229798&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:42.711 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768229802 status=200 resp_size=5194
2026-01-12 22:56:43.018 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229802&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:51.358 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768229810 status=200 resp_size=5556
2026-01-12 22:56:51.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229811&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:56.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768229816 status=200 resp_size=6332
2026-01-12 22:56:57.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229816&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 22:57:04.998 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768229824 status=200 resp_size=5640
2026-01-12 22:57:05.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229824&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:57:08.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768229828 status=200 resp_size=5171
2026-01-12 22:57:09.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229828&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 22:57:15.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768229834 status=200 resp_size=8637
2026-01-12 22:57:16.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229835&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 22:57:26.224 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768229845 status=200 resp_size=6170
2026-01-12 22:57:26.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229846&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 22:57:36.073 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768229855 status=200 resp_size=6609
2026-01-12 22:57:36.504 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229856&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 22:57:45.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768229864 status=200 resp_size=5893
2026-01-12 22:57:45.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229865&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 22:57:53.976 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768229873 status=200 resp_size=5813
2026-01-12 22:57:54.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229873&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:58:01.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768229880 status=200 resp_size=8323
2026-01-12 22:58:01.573 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229881&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-12 22:58:11.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768229890 status=200 resp_size=6056
2026-01-12 22:58:11.908 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229891&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:58:22.443 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768229901 status=200 resp_size=4922
2026-01-12 22:58:22.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229902&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 22:58:26.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768229906 status=200 resp_size=6081
2026-01-12 22:58:27.154 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229906&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:58:32.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768229912 status=200 resp_size=6417
2026-01-12 22:58:32.481 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229912&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:58:37.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768229917 status=200 resp_size=7054
2026-01-12 22:58:37.906 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229917&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 22:58:39.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768229919 status=200 resp_size=5738
2026-01-12 22:58:39.651 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229919&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:58:49.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768229928 status=200 resp_size=5476
2026-01-12 22:58:49.692 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229929&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 22:58:49.692 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 22:58:49.750 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:58:49.751 | INFO | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 22:58:49.751 | INFO | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 22:58:59.690 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.94 秒后继续...
2026-01-12 22:58:59.690 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 2/26 页...
2026-01-12 22:58:59.690 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:58:59.817 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 22:59:00.380 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:01.508 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:03.709 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:03.709 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:59:04.257 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229939 status=200 resp_size=112032
2026-01-12 22:59:04.257 | INFO | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:59:04.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768229944 status=200 resp_size=6037
2026-01-12 22:59:04.821 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229944&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:59:13.117 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768229952 status=200 resp_size=6268
2026-01-12 22:59:13.313 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229953&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 22:59:20.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768229959 status=200 resp_size=5738
2026-01-12 22:59:20.332 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229960&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 22:59:28.489 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768229967 status=200 resp_size=5638
2026-01-12 22:59:28.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229968&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:59:36.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768229976 status=200 resp_size=6388
2026-01-12 22:59:36.907 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229976&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 22:59:46.362 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768229985 status=200 resp_size=5102
2026-01-12 22:59:46.542 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229986&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:59:54.729 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768229993 status=200 resp_size=6273
2026-01-12 22:59:54.975 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229994&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 22:59:57.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768229996 status=200 resp_size=5373
2026-01-12 22:59:57.266 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229997&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 23:00:00.851 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768230000 status=200 resp_size=6433
2026-01-12 23:00:01.085 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230000&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:00:05.130 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768230004 status=200 resp_size=5182
2026-01-12 23:00:05.546 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230005&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 23:00:08.005 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768230007 status=200 resp_size=5022
2026-01-12 23:00:08.631 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230008&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 23:00:12.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768230010 status=200 resp_size=6134
2026-01-12 23:00:13.637 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230012&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 23:00:27.605 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768230020 status=200 resp_size=7193
2026-01-12 23:00:30.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230027&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 23:00:36.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768230036 status=200 resp_size=5613
2026-01-12 23:00:37.207 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230036&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 23:00:44.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768230043 status=200 resp_size=5128
2026-01-12 23:00:44.660 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230044&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 23:00:48.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768230048 status=200 resp_size=5966
2026-01-12 23:00:48.709 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230048&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 23:00:56.593 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768230055 status=200 resp_size=6188
2026-01-12 23:00:56.789 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230056&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 23:01:01.265 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768230060 status=200 resp_size=5623
2026-01-12 23:01:01.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230061&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:01:06.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768230065 status=200 resp_size=5839
2026-01-12 23:01:06.483 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230066&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:01:10.175 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768230069 status=200 resp_size=5407
2026-01-12 23:01:10.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230070&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:01:10.479 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 23:01:10.528 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:01:10.528 | INFO | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 23:01:19.869 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 9.34 秒后继续...
2026-01-12 23:01:19.869 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 3/26 页...
2026-01-12 23:01:19.869 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:01:19.893 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:01:20.762 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:21.971 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:24.201 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:24.202 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:01:24.741 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230079 status=200 resp_size=114501
2026-01-12 23:01:24.742 | INFO | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:01:25.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768230084 status=200 resp_size=6980
2026-01-12 23:01:25.254 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230085&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 23:01:27.278 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768230087 status=200 resp_size=5619
2026-01-12 23:01:27.584 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230087&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 23:01:37.100 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768230096 status=200 resp_size=5704
2026-01-12 23:01:37.301 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230097&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:01:47.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768230106 status=200 resp_size=5609
2026-01-12 23:01:48.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230107&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 23:01:57.066 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768230116 status=200 resp_size=5894
2026-01-12 23:01:57.263 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230117&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:02:07.186 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768230126 status=200 resp_size=6499
2026-01-12 23:02:07.392 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230127&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:02:14.732 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768230133 status=200 resp_size=5519
2026-01-12 23:02:15.023 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230134&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:02:25.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768230144 status=200 resp_size=5799
2026-01-12 23:02:25.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230145&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:02:29.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768230149 status=200 resp_size=6336
2026-01-12 23:02:29.878 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230149&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 23:02:34.329 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768230154 status=200 resp_size=5687
2026-01-12 23:02:34.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230154&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 23:02:37.543 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768230157 status=200 resp_size=6312
2026-01-12 23:02:38.778 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230157&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 23:02:48.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768230167 status=200 resp_size=5148
2026-01-12 23:02:48.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230168&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 23:02:49.827 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768230169 status=200 resp_size=6452
2026-01-12 23:02:50.072 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230169&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 23:02:54.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768230174 status=200 resp_size=5967
2026-01-12 23:02:54.404 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230174&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:02:59.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768230178 status=200 resp_size=5851
2026-01-12 23:02:59.274 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230179&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:03:10.075 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768230189 status=200 resp_size=5179
2026-01-12 23:03:10.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230190&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 23:03:17.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768230196 status=200 resp_size=8501
2026-01-12 23:03:17.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230197&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 23:03:23.725 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768230202 status=200 resp_size=6008
2026-01-12 23:03:23.961 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230203&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 23:03:34.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768230213 status=200 resp_size=6055
2026-01-12 23:03:34.436 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230214&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:03:41.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768230221 status=200 resp_size=5337
2026-01-12 23:03:41.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230221&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:03:41.918 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 23:03:41.958 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:03:41.963 | INFO | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 23:03:49.044 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.08 秒后继续...
2026-01-12 23:03:49.044 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 4/26 页...
2026-01-12 23:03:49.045 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:03:49.086 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:03:51.200 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:52.804 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:55.409 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:55.409 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:03:56.639 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230229 status=200 resp_size=111196
2026-01-12 23:03:56.639 | INFO | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:03:57.092 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768230236 status=200 resp_size=5746
2026-01-12 23:03:57.648 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230237&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:04:02.205 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768230241 status=200 resp_size=5731
2026-01-12 23:04:04.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230242&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 23:04:07.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768230246 status=200 resp_size=5762
2026-01-12 23:04:09.526 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230247&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:04:17.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768230256 status=200 resp_size=5946
2026-01-12 23:04:17.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230257&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:04:22.275 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768230262 status=200 resp_size=5295
2026-01-12 23:04:22.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230262&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-12 23:04:29.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768230268 status=200 resp_size=5733
2026-01-12 23:04:29.618 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230269&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:04:40.308 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768230279 status=200 resp_size=6173
2026-01-12 23:04:40.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230280&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:04:49.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161093063?api_key=51job&timestamp=1768230289 status=200 resp_size=4899
2026-01-12 23:04:50.065 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230289&companyId=9298193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 23:04:59.749 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768230299 status=200 resp_size=5464
2026-01-12 23:04:59.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230299&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-12 23:05:04.142 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768230303 status=200 resp_size=5238
2026-01-12 23:05:04.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230304&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:05:13.806 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768230312 status=200 resp_size=6030
2026-01-12 23:05:13.980 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230313&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 23:05:21.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768230320 status=200 resp_size=5488
2026-01-12 23:05:21.754 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230321&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:05:29.928 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169107661?api_key=51job&timestamp=1768230329 status=200 resp_size=6874
2026-01-12 23:05:30.158 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230329&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:05:40.610 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768230339 status=200 resp_size=5278
2026-01-12 23:05:40.918 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230340&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:05:43.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768230343 status=200 resp_size=5640
2026-01-12 23:05:44.198 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230343&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:05:47.777 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768230347 status=200 resp_size=5894
2026-01-12 23:05:48.026 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230347&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:06:03.295 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768230355 status=200 resp_size=5654
2026-01-12 23:06:05.682 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230363&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-12 23:06:10.222 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768230368 status=200 resp_size=6669
2026-01-12 23:06:16.865 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230370&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:06:21.467 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768230378 status=200 resp_size=4201
2026-01-12 23:06:23.964 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230381&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-12 23:06:33.245 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768230392 status=200 resp_size=6444
2026-01-12 23:06:33.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230393&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:06:33.449 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 23:06:41.631 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:06:41.631 | INFO | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 23:06:44.317 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 2.68 秒后继续...
2026-01-12 23:06:44.317 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 5/26 页...
2026-01-12 23:06:44.317 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:06:44.356 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:06:44.922 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:46.039 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:48.168 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:48.168 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:06:48.571 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230404 status=200 resp_size=140372
2026-01-12 23:06:48.573 | INFO | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:06:48.756 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768230408 status=200 resp_size=5925
2026-01-12 23:06:48.930 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230408&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 23:07:00.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768230414 status=200 resp_size=6201
2026-01-12 23:07:03.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230420&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 23:07:06.498 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768230424 status=200 resp_size=6410
2026-01-12 23:07:11.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230426&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:07:16.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768230435 status=200 resp_size=6079
2026-01-12 23:07:28.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230436&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 23:07:35.990 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768230453 status=200 resp_size=7774
2026-01-12 23:07:39.703 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230455&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 23:07:53.091 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768230465 status=200 resp_size=6551
2026-01-12 23:07:54.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230473&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:07:58.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169552998?api_key=51job&timestamp=1768230475 status=200 resp_size=5844
2026-01-12 23:08:00.059 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230478&companyId=10081630&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2698
2026-01-12 23:08:02.919 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768230481 status=200 resp_size=5923
2026-01-12 23:08:04.292 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230482&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:08:12.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768230488 status=200 resp_size=6064
2026-01-12 23:08:13.368 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230492&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:08:17.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768230497 status=200 resp_size=5508
2026-01-12 23:08:18.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230497&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-12 23:08:27.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768230506 status=200 resp_size=6874
2026-01-12 23:08:27.880 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230507&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8133
2026-01-12 23:08:36.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167749069?api_key=51job&timestamp=1768230515 status=200 resp_size=6231
2026-01-12 23:08:36.299 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230516&companyId=296713&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7824
2026-01-12 23:08:42.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129561?api_key=51job&timestamp=1768230521 status=200 resp_size=9214
2026-01-12 23:08:42.638 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230522&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:08:50.912 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768230529 status=200 resp_size=6491
2026-01-12 23:08:51.088 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:09:01.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128290?api_key=51job&timestamp=1768230540 status=200 resp_size=10186
2026-01-12 23:09:01.288 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230541&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:09:10.479 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768230549 status=200 resp_size=7105
2026-01-12 23:09:10.721 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230550&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 23:09:18.144 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768230557 status=200 resp_size=9049
2026-01-12 23:09:18.410 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230558&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7521
2026-01-12 23:09:25.647 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768230565 status=200 resp_size=6780
2026-01-12 23:09:25.831 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230565&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:09:36.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169604659?api_key=51job&timestamp=1768230575 status=200 resp_size=7166
2026-01-12 23:09:37.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230576&companyId=2016195&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4559
2026-01-12 23:09:42.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768230581 status=200 resp_size=6821
2026-01-12 23:09:42.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230582&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-12 23:09:42.376 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 23:09:42.477 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:09:42.477 | INFO | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 23:09:50.456 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.97 秒后继续...
2026-01-12 23:09:50.456 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 6/26 页...
2026-01-12 23:09:50.457 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:09:50.512 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:09:51.156 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:52.347 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:54.505 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:54.505 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:09:54.969 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230590 status=200 resp_size=161299
2026-01-12 23:09:54.974 | INFO | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:09:55.164 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170017735?api_key=51job&timestamp=1768230594 status=200 resp_size=6257
2026-01-12 23:09:55.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230595&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 23:10:01.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768230600 status=200 resp_size=5429
2026-01-12 23:10:01.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230601&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:10:08.147 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768230607 status=200 resp_size=6591
2026-01-12 23:10:08.381 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230608&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 23:10:17.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768230616 status=200 resp_size=6755
2026-01-12 23:10:17.521 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230617&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 23:10:22.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169927328?api_key=51job&timestamp=1768230622 status=200 resp_size=9189
2026-01-12 23:10:23.137 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230622&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:10:30.922 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768230630 status=200 resp_size=7002
2026-01-12 23:10:31.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230630&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:10:33.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768230633 status=200 resp_size=5732
2026-01-12 23:10:33.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230633&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:10:35.372 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768230635 status=200 resp_size=5262
2026-01-12 23:10:35.625 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230635&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12331
2026-01-12 23:10:44.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768230643 status=200 resp_size=6074
2026-01-12 23:10:45.259 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230644&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 23:10:53.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768230653 status=200 resp_size=6570
2026-01-12 23:10:54.039 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230653&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:01.562 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167516?api_key=51job&timestamp=1768230660 status=200 resp_size=6493
2026-01-12 23:11:01.839 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230661&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:11:06.551 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170018599?api_key=51job&timestamp=1768230666 status=200 resp_size=6937
2026-01-12 23:11:06.746 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230666&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 23:11:09.330 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768230669 status=200 resp_size=5513
2026-01-12 23:11:09.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230669&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:11.055 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169860176?api_key=51job&timestamp=1768230670 status=200 resp_size=6601
2026-01-12 23:11:11.260 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230671&companyId=1128753&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9600
2026-01-12 23:11:13.926 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66521396?api_key=51job&timestamp=1768230673 status=200 resp_size=6694
2026-01-12 23:11:14.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230673&companyId=3220556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5999
2026-01-12 23:11:23.074 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259937?api_key=51job&timestamp=1768230682 status=200 resp_size=5729
2026-01-12 23:11:23.341 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230683&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 23:11:29.209 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768230688 status=200 resp_size=7569
2026-01-12 23:11:29.364 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230689&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-12 23:11:39.102 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768230698 status=200 resp_size=6707
2026-01-12 23:11:39.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230699&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:49.727 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153925506?api_key=51job&timestamp=1768230708 status=200 resp_size=5809
2026-01-12 23:11:49.946 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230709&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:11:59.247 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129464?api_key=51job&timestamp=1768230718 status=200 resp_size=8602
2026-01-12 23:11:59.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230719&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:11:59.442 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 20
2026-01-12 23:11:59.562 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:11:59.562 | INFO | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-12 23:12:02.580 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.01 秒后继续...
2026-01-12 23:12:02.582 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 7/26 页...
2026-01-12 23:12:02.582 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:12:02.628 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:12:07.737 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:09.396 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:13.611 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:13.611 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:12:17.242 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230722 status=200 resp_size=151330
2026-01-12 23:12:17.242 | INFO | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:12:18.283 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168488694?api_key=51job&timestamp=1768230737 status=200 resp_size=6853
2026-01-12 23:12:19.234 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230738&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 23:12:27.958 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768230747 status=200 resp_size=6302
2026-01-12 23:12:28.172 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230747&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:12:29.804 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768230749 status=200 resp_size=5916
2026-01-12 23:12:30.008 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230749&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 23:12:33.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768230752 status=200 resp_size=7778
2026-01-12 23:12:33.644 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230753&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-12 23:12:43.214 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163530512?api_key=51job&timestamp=1768230762 status=200 resp_size=5225
2026-01-12 23:12:43.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230763&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:12:50.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768230770 status=200 resp_size=6276
2026-01-12 23:12:51.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230770&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:12:59.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768230778 status=200 resp_size=5328
2026-01-12 23:12:59.395 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230779&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:13:05.513 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163452370?api_key=51job&timestamp=1768230784 status=200 resp_size=5948
2026-01-12 23:13:05.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230785&companyId=3031347&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6454
2026-01-12 23:13:07.354 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768230787 status=200 resp_size=7210
2026-01-12 23:13:07.555 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230787&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-12 23:13:14.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768230793 status=200 resp_size=6242
2026-01-12 23:13:15.103 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230794&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:13:22.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129002?api_key=51job&timestamp=1768230801 status=200 resp_size=9018
2026-01-12 23:13:22.841 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230802&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:13:29.405 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376468?api_key=51job&timestamp=1768230808 status=200 resp_size=6716
2026-01-12 23:13:29.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230809&companyId=2297693&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10416
2026-01-12 23:13:34.106 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169414013?api_key=51job&timestamp=1768230813 status=200 resp_size=10475
2026-01-12 23:13:34.262 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230814&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:13:43.758 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768230822 status=200 resp_size=8830
2026-01-12 23:13:44.041 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230823&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:13:46.741 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168361598?api_key=51job&timestamp=1768230826 status=200 resp_size=5980
2026-01-12 23:13:46.934 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230826&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 23:13:54.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768230833 status=200 resp_size=5688
2026-01-12 23:13:54.391 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230834&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:14:02.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768230842 status=200 resp_size=8231
2026-01-12 23:14:02.825 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230842&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 23:14:06.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169917574?api_key=51job&timestamp=1768230845 status=200 resp_size=6563
2026-01-12 23:14:06.167 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230846&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:14:16.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156555837?api_key=51job&timestamp=1768230855 status=200 resp_size=7527
2026-01-12 23:14:17.019 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230856&companyId=692384&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5000
2026-01-12 23:14:27.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768230866 status=200 resp_size=7517
2026-01-12 23:14:27.689 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230867&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 23:14:27.690 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据，包含详细信息的数据条数: 20
2026-01-12 23:14:27.802 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:14:27.803 | INFO | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-12 23:14:29.366 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 1.56 秒后继续...
2026-01-12 23:14:29.366 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 8/26 页...
2026-01-12 23:14:29.366 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:14:29.394 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:14:29.998 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:31.168 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:33.399 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:33.399 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:14:33.951 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230869 status=200 resp_size=144474
2026-01-12 23:14:33.955 | INFO | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:14:34.151 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170115317?api_key=51job&timestamp=1768230873 status=200 resp_size=10974
2026-01-12 23:14:34.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230874&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:14:40.346 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768230879 status=200 resp_size=6463
2026-01-12 23:14:40.509 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230880&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:14:49.290 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768230888 status=200 resp_size=5621
2026-01-12 23:14:49.438 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230889&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:14:51.113 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768230890 status=200 resp_size=6736
2026-01-12 23:14:51.322 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230891&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 23:15:00.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768230900 status=200 resp_size=6198
2026-01-12 23:15:01.050 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230900&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-12 23:15:05.490 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768230905 status=200 resp_size=5017
2026-01-12 23:15:05.680 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230905&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:15:13.951 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768230913 status=200 resp_size=5683
2026-01-12 23:15:14.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230913&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-12 23:15:22.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768230921 status=200 resp_size=6702
2026-01-12 23:15:22.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230922&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-12 23:15:25.826 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768230925 status=200 resp_size=5146
2026-01-12 23:15:26.031 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230925&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 23:15:27.917 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768230927 status=200 resp_size=6519
2026-01-12 23:15:28.187 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230927&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:15:36.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768230936 status=200 resp_size=8382
2026-01-12 23:15:37.078 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230936&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 23:15:46.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768230945 status=200 resp_size=7332
2026-01-12 23:15:47.125 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230946&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10582
2026-01-12 23:16:01.157 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768230953 status=200 resp_size=5924
2026-01-12 23:16:31.174 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:16:40.022 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230961&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-12 23:16:47.232 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170124203?api_key=51job&timestamp=1768231006 status=200 resp_size=5682
2026-01-12 23:16:47.440 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231007&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:16:54.820 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948611?api_key=51job&timestamp=1768231014 status=200 resp_size=6442
2026-01-12 23:16:54.966 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231014&companyId=7226894&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6269
2026-01-12 23:16:59.315 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768231019 status=200 resp_size=6043
2026-01-12 23:16:59.520 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231019&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-12 23:17:39.104 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768231027 status=200 resp_size=5893
2026-01-12 23:17:40.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231059&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5455
2026-01-12 23:18:13.793 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768231063 status=200 resp_size=6519
2026-01-12 23:18:21.544 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231093&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:18:35.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768231109 status=200 resp_size=5946
2026-01-12 23:18:37.574 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231115&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-12 23:18:44.787 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768231124 status=200 resp_size=6067
2026-01-12 23:18:44.963 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231124&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-12 23:18:44.963 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据，包含详细信息的数据条数: 20
2026-01-12 23:18:45.033 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:18:45.033 | INFO | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-12 23:18:52.852 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.82 秒后继续...
2026-01-12 23:18:52.852 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 9/26 页...
2026-01-12 23:18:52.853 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:18:52.878 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:18:53.741 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:54.956 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:57.163 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:57.163 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:18:57.752 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231132 status=200 resp_size=135484
2026-01-12 23:18:57.752 | INFO | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:18:58.051 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168502014?api_key=51job&timestamp=1768231137 status=200 resp_size=5719
2026-01-12 23:18:58.304 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231138&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 23:19:01.888 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168450398?api_key=51job&timestamp=1768231141 status=200 resp_size=6056
2026-01-12 23:19:02.197 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231141&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:19:06.973 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768231146 status=200 resp_size=7000
2026-01-12 23:19:07.219 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231146&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 23:19:11.493 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768231151 status=200 resp_size=5131
2026-01-12 23:19:11.720 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231151&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 23:19:20.119 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768231159 status=200 resp_size=7141
2026-01-12 23:19:20.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231160&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 23:20:07.536 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:20:34.048 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768231168 status=200 resp_size=8475
2026-01-12 23:20:48.281 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231234&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:20:55.063 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768231254 status=200 resp_size=13120
2026-01-12 23:20:55.350 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231255&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 23:20:57.101 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768231256 status=200 resp_size=5761
2026-01-12 23:20:57.303 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231257&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-12 23:21:04.120 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634560?api_key=51job&timestamp=1768231263 status=200 resp_size=5806
2026-01-12 23:21:04.297 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231264&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:21:15.012 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768231274 status=200 resp_size=6159
2026-01-12 23:21:15.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231275&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:21:24.742 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170029379?api_key=51job&timestamp=1768231284 status=200 resp_size=10587
2026-01-12 23:21:24.923 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231284&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:21:33.152 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224996?api_key=51job&timestamp=1768231292 status=200 resp_size=4633
2026-01-12 23:21:33.441 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231293&companyId=10149556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2624
2026-01-12 23:21:43.771 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100789?api_key=51job&timestamp=1768231303 status=200 resp_size=5696
2026-01-12 23:21:43.995 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231303&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:21:47.981 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768231307 status=200 resp_size=7971
2026-01-12 23:21:48.159 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231307&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 23:21:57.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110949?api_key=51job&timestamp=1768231316 status=200 resp_size=6193
2026-01-12 23:21:57.302 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231317&companyId=10137280&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2743
2026-01-12 23:22:05.905 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166843455?api_key=51job&timestamp=1768231324 status=200 resp_size=9540
2026-01-12 23:22:06.211 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231325&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 23:22:14.203 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169943708?api_key=51job&timestamp=1768231333 status=200 resp_size=5987
2026-01-12 23:22:14.386 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231334&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:22:25.153 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768231344 status=200 resp_size=6606
2026-01-12 23:22:25.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231345&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7910
2026-01-12 23:22:28.549 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768231348 status=200 resp_size=7299
2026-01-12 23:22:28.791 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231348&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-12 23:22:30.272 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170142499?api_key=51job&timestamp=1768231349 status=200 resp_size=5260
2026-01-12 23:22:30.580 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231350&companyId=3863622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7117
2026-01-12 23:22:30.580 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据，包含详细信息的数据条数: 20
2026-01-12 23:22:30.650 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:22:30.650 | INFO | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-12 23:22:35.674 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.02 秒后继续...
2026-01-12 23:22:35.674 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 10/26 页...
2026-01-12 23:22:35.674 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:22:35.694 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:22:36.313 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:37.459 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:39.606 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:39.607 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:22:40.016 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231355 status=200 resp_size=142665
2026-01-12 23:22:40.016 | WARNING | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位（已跳过）
2026-01-12 23:22:40.017 | INFO | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:22:40.280 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935463?api_key=51job&timestamp=1768231360 status=200 resp_size=5415
2026-01-12 23:22:40.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231360&companyId=10093538&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3901
2026-01-12 23:22:44.869 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768231364 status=200 resp_size=5364
2026-01-12 23:22:45.087 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231364&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-12 23:22:48.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768231368 status=200 resp_size=5458
2026-01-12 23:22:48.828 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231368&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 23:22:57.898 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169046179?api_key=51job&timestamp=1768231377 status=200 resp_size=5670
2026-01-12 23:22:58.038 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231377&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:23:01.097 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768231380 status=200 resp_size=7227
2026-01-12 23:23:01.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231381&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 23:23:11.355 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169936726?api_key=51job&timestamp=1768231390 status=200 resp_size=6450
2026-01-12 23:23:11.569 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231391&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 23:23:13.512 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169034126?api_key=51job&timestamp=1768231393 status=200 resp_size=8159
2026-01-12 23:23:13.753 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231393&companyId=7642544&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6020
2026-01-12 23:23:21.844 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768231400 status=200 resp_size=5800
2026-01-12 23:23:22.077 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231401&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:23:30.311 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063888?api_key=51job&timestamp=1768231409 status=200 resp_size=5760
2026-01-12 23:23:30.596 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231410&companyId=10131346&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6066
2026-01-12 23:23:39.076 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052041?api_key=51job&timestamp=1768231418 status=200 resp_size=7503
2026-01-12 23:23:39.300 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231419&companyId=3967456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11455
2026-01-12 23:23:45.948 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768231425 status=200 resp_size=9486
2026-01-12 23:23:46.256 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231425&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 23:23:50.591 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768231430 status=200 resp_size=5744
2026-01-12 23:23:50.863 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231430&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10659
2026-01-12 23:23:57.427 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088704?api_key=51job&timestamp=1768231436 status=200 resp_size=7963
2026-01-12 23:23:57.724 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231437&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 23:24:05.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768231444 status=200 resp_size=6706
2026-01-12 23:24:05.577 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231445&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-12 23:24:16.434 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768231455 status=200 resp_size=5281
2026-01-12 23:24:16.667 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231456&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 23:24:28.730 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158175505?api_key=51job&timestamp=1768231461 status=200 resp_size=7072
2026-01-12 23:24:29.894 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231468&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 23:24:34.466 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768231473 status=200 resp_size=5277
2026-01-12 23:24:35.620 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231474&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 23:24:52.674 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768231484 status=200 resp_size=6107
2026-01-12 23:24:53.673 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231492&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 23:24:58.616 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154053858?api_key=51job&timestamp=1768231496 status=200 resp_size=6883
2026-01-12 23:25:03.058 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231498&companyId=3396091&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8076
2026-01-12 23:25:03.058 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据，包含详细信息的数据条数: 19
2026-01-12 23:25:11.318 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 23:25:11.319 | INFO | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-12 23:25:14.495 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
2026-01-12 23:25:14.495 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 11/26 页...
2026-01-12 23:25:14.496 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:25:14.555 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:25:15.330 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:16.585 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:18.763 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:18.763 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:25:19.258 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231514 status=200 resp_size=138259
2026-01-12 23:25:19.259 | WARNING | __main__:get_recommend_jobs:745 - 第 11 页发现 3 个重复职位（已跳过）
2026-01-12 23:25:19.259 | INFO | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位（去重后: 17） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:25:19.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768231519 status=200 resp_size=4916
2026-01-12 23:25:19.849 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231519&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 23:25:23.227 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768231522 status=200 resp_size=6083
2026-01-12 23:25:23.449 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231523&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-12 23:25:25.070 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357292?api_key=51job&timestamp=1768231524 status=200 resp_size=6485
2026-01-12 23:25:25.377 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231525&companyId=2255809&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8093
2026-01-12 23:25:32.547 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140557776?api_key=51job&timestamp=1768231531 status=200 resp_size=5399
2026-01-12 23:25:32.887 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231532&companyId=2940827&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10918
2026-01-12 23:25:34.785 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768231534 status=200 resp_size=5996
2026-01-12 23:25:35.013 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231534&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:25:40.225 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165654123?api_key=51job&timestamp=1768231539 status=200 resp_size=6529
2026-01-12 23:25:40.451 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231540&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 23:25:58.775 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169128572?api_key=51job&timestamp=1768231549 status=200 resp_size=5337
2026-01-12 23:26:03.367 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231558&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 23:26:09.735 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169756645?api_key=51job&timestamp=1768231567 status=200 resp_size=6386
2026-01-12 23:26:14.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231569&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 23:26:45.669 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166253577?api_key=51job&timestamp=1768231584 status=200 resp_size=6219
2026-01-12 23:26:48.016 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231605&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:27:04.655 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768231612 status=200 resp_size=6222
2026-01-12 23:27:18.284 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231624&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-12 23:27:50.579 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:27:52.318 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768231640 status=200 resp_size=5669
2026-01-12 23:27:52.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231672&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-12 23:27:57.320 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170233170?api_key=51job&timestamp=1768231677 status=200 resp_size=6536
2026-01-12 23:27:57.500 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231677&companyId=10150186&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6054
2026-01-12 23:27:59.792 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148568?api_key=51job&timestamp=1768231679 status=200 resp_size=9405
2026-01-12 23:27:59.971 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231679&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:28:02.455 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768231682 status=200 resp_size=6534
2026-01-12 23:28:02.636 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231682&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2860
2026-01-12 23:28:06.502 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134905?api_key=51job&timestamp=1768231686 status=200 resp_size=7369
2026-01-12 23:28:06.757 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231686&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 23:28:13.925 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768231693 status=200 resp_size=8723
2026-01-12 23:28:14.132 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231693&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-12 23:28:15.563 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169966668?api_key=51job&timestamp=1768231695 status=200 resp_size=9642
2026-01-12 23:28:15.776 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231695&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:28:15.776 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据，包含详细信息的数据条数: 17
2026-01-12 23:28:15.831 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-12 23:28:15.831 | INFO | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-12 23:28:21.067 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 5.23 秒后继续...
2026-01-12 23:28:21.067 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 12/26 页...
2026-01-12 23:28:21.067 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:28:21.092 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:28:22.059 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:23.247 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:25.497 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:25.497 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:28:26.056 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231701 status=200 resp_size=132531
2026-01-12 23:28:26.056 | INFO | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:28:26.370 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169651289?api_key=51job&timestamp=1768231706 status=200 resp_size=5902
2026-01-12 23:28:26.614 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231706&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 23:28:32.524 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768231711 status=200 resp_size=5719
2026-01-12 23:28:32.779 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231712&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7174
2026-01-12 23:28:42.566 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166552266?api_key=51job&timestamp=1768231722 status=200 resp_size=6217
2026-01-12 23:28:42.803 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231722&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 23:28:45.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768231725 status=200 resp_size=6166
2026-01-12 23:28:45.874 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231725&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:28:48.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768231727 status=200 resp_size=6885
2026-01-12 23:28:48.338 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231728&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:28:54.993 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165412012?api_key=51job&timestamp=1768231734 status=200 resp_size=6777
2026-01-12 23:28:55.208 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231734&companyId=3733053&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11037
2026-01-12 23:29:02.677 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/124654690?api_key=51job&timestamp=1768231741 status=200 resp_size=6256
2026-01-12 23:29:02.862 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231742&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:29:42.007 | ERROR | __main__:_make_request:632 - 请求异常 (尝试 1/3): _ssl.c:985: The handshake operation timed out
2026-01-12 23:29:42.007 | WARNING | __main__:_make_request:637 - 检测到代理相关异常: _ssl.c:985: The handshake operation timed out
2026-01-12 23:29:42.007 | WARNING | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:29:42.007 | WARNING | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-12 23:29:42.007 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:29:42.710 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768231750 status=200 resp_size=6190
2026-01-12 23:29:42.864 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231782&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 23:29:49.210 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768231788 status=200 resp_size=5396
2026-01-12 23:29:49.447 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231789&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-12 23:30:01.027 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768231798 status=200 resp_size=5177
2026-01-12 23:30:02.218 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231801&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-12 23:30:05.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768231804 status=200 resp_size=4986
2026-01-12 23:30:06.450 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231805&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:30:14.345 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768231813 status=200 resp_size=5398
2026-01-12 23:30:14.554 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231814&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-12 23:30:21.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768231820 status=200 resp_size=6568
2026-01-12 23:30:21.413 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231821&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:24.693 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768231824 status=200 resp_size=5728
2026-01-12 23:30:25.099 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231824&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-12 23:30:30.690 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768231830 status=200 resp_size=6933
2026-01-12 23:30:30.845 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231830&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 23:30:33.705 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768231833 status=200 resp_size=5298
2026-01-12 23:30:33.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231833&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-12 23:30:41.910 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768231840 status=200 resp_size=6296
2026-01-12 23:30:42.199 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231841&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:49.439 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768231848 status=200 resp_size=6588
2026-01-12 23:30:49.684 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231849&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-12 23:30:51.935 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768231851 status=200 resp_size=6085
2026-01-12 23:30:52.136 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231851&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:56.507 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768231856 status=200 resp_size=5014
2026-01-12 23:30:56.748 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231856&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-12 23:30:56.748 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据，包含详细信息的数据条数: 20
2026-01-12 23:30:56.830 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:30:56.830 | INFO | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-12 23:31:05.101 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 8.27 秒后继续...
2026-01-12 23:31:05.101 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 13/26 页...
2026-01-12 23:31:05.101 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:31:05.115 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:31:05.632 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:06.744 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:08.875 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:08.875 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:31:09.368 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231865 status=200 resp_size=114475
2026-01-12 23:31:09.368 | INFO | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:31:09.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768231869 status=200 resp_size=5354
2026-01-12 23:31:09.785 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231869&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 23:31:17.095 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768231876 status=200 resp_size=4913
2026-01-12 23:31:17.428 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231877&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 23:31:26.028 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768231885 status=200 resp_size=7224
2026-01-12 23:31:26.202 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231886&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 23:31:30.021 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768231889 status=200 resp_size=5700
2026-01-12 23:31:30.285 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231890&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:31:37.000 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768231896 status=200 resp_size=6948
2026-01-12 23:31:37.291 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231897&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 23:32:01.030 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768231907 status=200 resp_size=5584
2026-01-12 23:32:01.770 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:32:09.248 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768231928 status=200 resp_size=7138
2026-01-12 23:32:09.418 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231929&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 23:32:16.944 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768231935 status=200 resp_size=5280
2026-01-12 23:32:17.448 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231936&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 23:32:27.672 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768231947 status=200 resp_size=5070
2026-01-12 23:32:27.854 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231947&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-12 23:32:31.759 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768231951 status=200 resp_size=5389
2026-01-12 23:32:31.932 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231951&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:32:42.319 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768231961 status=200 resp_size=4879
2026-01-12 23:32:42.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231962&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:32:52.353 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768231971 status=200 resp_size=6774
2026-01-12 23:32:52.565 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231972&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:33:01.884 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768231981 status=200 resp_size=5308
2026-01-12 23:33:02.190 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231981&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 23:33:05.744 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768231985 status=200 resp_size=5770
2026-01-12 23:33:05.977 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231985&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 23:33:09.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768231989 status=200 resp_size=5467
2026-01-12 23:33:09.796 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231989&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 23:33:14.531 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768231994 status=200 resp_size=5509
2026-01-12 23:33:14.701 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231994&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 23:33:23.324 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768232002 status=200 resp_size=4791
2026-01-12 23:33:23.752 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232003&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 23:33:29.014 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768232008 status=200 resp_size=6762
2026-01-12 23:33:29.316 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232009&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 23:33:35.678 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768232015 status=200 resp_size=5183
2026-01-12 23:33:35.872 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232015&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:33:37.201 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768232016 status=200 resp_size=4902
2026-01-12 23:33:37.406 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232017&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 23:33:37.406 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据，包含详细信息的数据条数: 20
2026-01-12 23:33:37.463 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:33:37.463 | INFO | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-12 23:33:44.767 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 7.30 秒后继续...
2026-01-12 23:33:44.767 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 14/26 页...
2026-01-12 23:33:44.768 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:33:44.792 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:33:45.497 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:46.632 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:48.876 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:48.876 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:33:49.410 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768232024 status=200 resp_size=154928
2026-01-12 23:33:49.410 | INFO | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:33:49.594 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768232029 status=200 resp_size=5280
2026-01-12 23:33:49.766 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232029&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-12 23:33:59.323 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768232038 status=200 resp_size=5892
2026-01-12 23:33:59.588 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232039&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 23:34:09.460 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768232048 status=200 resp_size=7111
2026-01-12 23:34:09.712 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232049&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 23:34:11.913 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768232051 status=200 resp_size=7664
2026-01-12 23:34:13.140 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232051&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 23:34:22.463 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768232061 status=200 resp_size=6340
2026-01-12 23:34:22.772 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232062&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 23:34:26.169 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768232065 status=200 resp_size=4808
2026-01-12 23:34:26.473 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232066&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-12 23:34:28.287 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169233720?api_key=51job&timestamp=1768232068 status=200 resp_size=11961
2026-01-12 23:34:28.607 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232068&companyId=2911011&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7823
2026-01-12 23:34:35.243 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768232074 status=200 resp_size=9126
2026-01-12 23:34:35.469 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232075&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-12 23:34:39.156 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768232078 status=200 resp_size=6138
2026-01-12 23:34:39.359 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232079&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6960
2026-01-12 23:34:43.523 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154072?api_key=51job&timestamp=1768232083 status=200 resp_size=5843
2026-01-12 23:34:43.866 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232083&companyId=10105052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2583
2026-01-12 23:34:53.797 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768232091 status=200 resp_size=5259
2026-01-12 23:34:54.617 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232093&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-12 23:35:04.939 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768232104 status=200 resp_size=5703
2026-01-12 23:35:05.114 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232104&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7408
2026-01-12 23:35:06.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147062300?api_key=51job&timestamp=1768232106 status=200 resp_size=7061
2026-01-12 23:35:06.728 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232106&companyId=2859609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5470
2026-01-12 23:35:10.969 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768232110 status=200 resp_size=6392
2026-01-12 23:35:11.122 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232110&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 23:35:13.343 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169961053?api_key=51job&timestamp=1768232113 status=200 resp_size=7172
2026-01-12 23:35:13.503 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232113&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:35:14.668 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138538822?api_key=51job&timestamp=1768232114 status=200 resp_size=7607
2026-01-12 23:35:14.830 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232114&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 23:35:25.539 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768232124 status=200 resp_size=7276
2026-01-12 23:35:25.745 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232125&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 23:35:28.476 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170005961?api_key=51job&timestamp=1768232128 status=200 resp_size=6791
2026-01-12 23:35:28.716 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232128&companyId=6410180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5579
2026-01-12 23:35:33.487 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768232133 status=200 resp_size=6941
2026-01-12 23:35:33.734 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232133&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-12 23:35:38.956 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150106642?api_key=51job&timestamp=1768232138 status=200 resp_size=6561
2026-01-12 23:35:39.162 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232138&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 23:35:39.162 | INFO | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据，包含详细信息的数据条数: 20
2026-01-12 23:35:39.227 | INFO | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:35:39.227 | INFO | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-12 23:35:45.918 | INFO | __main__:crawl_multiple_pages:1045 - 休眠 6.69 秒后继续...
2026-01-12 23:35:45.918 | INFO | __main__:crawl_multiple_pages:1005 -
>>> 正在爬取第 15/26 页...
2026-01-12 23:35:45.919 | INFO | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:35:45.940 | INFO | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:35:46.691 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:47.865 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:50.020 | WARNING | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:50.022 | ERROR | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:35:50.571 | INFO | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768232145 status=200 resp_size=172452
2026-01-12 23:35:50.576 | INFO | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:35:50.834 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768232150 status=200 resp_size=6564
2026-01-12 23:35:51.036 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232150&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-12 23:35:54.317 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768232154 status=200 resp_size=6602
2026-01-12 23:35:54.519 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232154&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-12 23:36:03.371 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231674?api_key=51job&timestamp=1768232162 status=200 resp_size=5777
2026-01-12 23:36:03.559 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232163&companyId=6817482&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9941
2026-01-12 23:36:12.442 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768232171 status=200 resp_size=6297
2026-01-12 23:36:12.623 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232172&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-12 23:36:16.950 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634483?api_key=51job&timestamp=1768232176 status=200 resp_size=6145
2026-01-12 23:36:17.145 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232176&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:36:28.213 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768232186 status=200 resp_size=8774
2026-01-12 23:36:28.495 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232188&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 23:36:37.128 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768232196 status=200 resp_size=6727
2026-01-12 23:36:37.376 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232197&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14378
2026-01-12 23:36:46.541 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768232205 status=200 resp_size=8682
2026-01-12 23:36:46.747 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232206&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-12 23:36:49.997 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817474?api_key=51job&timestamp=1768232209 status=200 resp_size=6342
2026-01-12 23:36:50.229 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232209&companyId=2545142&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10393
2026-01-12 23:36:58.840 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768232218 status=200 resp_size=7334
2026-01-12 23:36:59.034 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232218&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:37:08.465 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768232226 status=200 resp_size=7940
2026-01-12 23:37:08.889 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232228&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 23:37:12.195 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768232231 status=200 resp_size=6531
2026-01-12 23:37:12.570 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232232&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-12 23:37:14.810 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768232233 status=200 resp_size=5922
2026-01-12 23:37:15.781 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232234&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-12 23:37:18.378 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768232237 status=200 resp_size=4719
2026-01-12 23:37:18.850 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232238&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-12 23:37:21.893 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768232241 status=200 resp_size=6743
2026-01-12 23:37:22.357 | INFO | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232241&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 23:37:31.285 | INFO | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 23:37:31.289 | INFO | __main__:close:1137 - httpx客户端已关闭
Reference in New Issue View Git Blame Copy Permalink