fix(twitter): use httpx User-Agent header by fllesser · Pull Request #595 · fllesser/nonebot-plugin-parser

fllesser · 2026-09-26T04:38:57Z

resovler #594

codecov · 2026-09-26T04:39:39Z

❌ 4 Tests Failed:

Tests completed	Failed	Passed	Skipped
44	4	40	4

View the top 3 failed test(s) by shortest run time

tests.parsers.test_bilibili_need_ck::test_no_audio_video

Stack Traces | 0.229s run time

tests/parsers/test_bilibili_need_ck.py:74: in test_no_audio_video
    video_url, audio_url = await parser.extract_download_urls(bvid="BV1gRjMziELt")
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/bilibili/__init__.py:328: in extract_download_urls
    download_url_data = await video.get_download_url(page_index=page_index)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:492: in get_download_url
    cid = await self.__get_cid_by_index(page_index)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:410: in __get_cid_by_index
    info = await self.__get_info_cached()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:311: in __get_info_cached
    return await self.get_info()
           ^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:247: in get_info
    await Api(**api, credential=self.credential).update_params(**params).result
.venv/lib/python3.14.../bilibili_api/utils/network.py:2393: in result
    return await self.request()
           ^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2385: in request
    raise e
.venv/lib/python3.14.../bilibili_api/utils/network.py:2376: in request
    return await self._request(raw=raw, byte=byte)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2342: in _request
    ret = self._process_response(resp=resp, raw=raw)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2280: in _process_response
    raise NetworkException(resp.code, resp.utf8_text())
E   bilibili_api.exceptions.NetworkException.NetworkException: 网络错误，状态码：412 - <!DOCTYPE html>
E   <html lang="zh-cn">
E   
E   <head>
E       <meta http-equiv="Access-Control-Allow-Origin" content="*" />
E       <meta http-equiv="Page-Enter" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Page-Exit" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
E       <meta name="viewport" content="width=device-width, user-scalable=no, initial-scale=1.0, maximum-scale=1.0, minimum-scale=1.0">
E       <meta name="spm_prefix" content="333.937">
E       <title>出错啦! - bilibili.com</title>
E       <link rel="shortcut icon" href="//static.hdslb.com/images/favicon.ico">
E       <script type="text/javascript" src="//s1.hdslb..../js/jquery/jquery1.7.2.min.js"></script>
E       <style>
E           body {
E             margin: 0;
E             padding: 0;
E             width: 100vw;
E             height: 100vh;
E           }
E          .error-container {
E             height: 100%;
E             width: 100%;
E             display: flex;
E             justify-content: center;
E             align-items: center;
E           }
E           .captcha-content {
E             text-align: center;
E           }
E           .txt-wrap {
E             margin-top: 15px;
E             font-size: 12px;
E             line-height: 22px;
E             color: #999;
E             text-align: left;
E           }
E           .txt-item.err-code {
E             font-size: 28px;
E             font-weight: 700;
E             text-align: center;
E             color: #4c93ff;
E             margin-top: 16px;
E           }
E           
E           .captcha-img {
E             width: 160px;
E             height: 160px;
E             margin: auto;
E             background: url('https://i0.hdslb..../jinkela/long/412/%E9%A1%B5%E9%9D%A2%E7%8A%B6%E6%80%81%E5%9B%BE.png') no-repeat center / cover;
E           }
E           .err-text {
E             color: #03a9f4;
E           }
E           .err-default {
E             font-size: 16px;
E             margin-top: 10px;
E           }
E         </style>
E   </head>
E   
E   <body>
E       <noscript>
E             <strong>抱歉！我们需要允许JavaScript才能够正常运行。请打开后重试~</strong>
E             <strong>错误：412</strong>
E         </noscript>
E         <div class="error-container">
E           <div class="captcha-content">
E             <div class="captcha-img"></div>
E             <div class="txt-item err-code">错误号: 412</div>
E             <div class="txt-item err-text"></div>
E             <div class="txt-item err-default">由于触发哔哩哔哩安全风控策略，该次访问请求被拒绝。 
E               <div class="txt-item">The request was rejected because of the bilibili security control policy.</div>
E             </div>
E             <div class="txt-wrap">
E               <div class="txt-item datetime_now"></div>
E               <div class="txt-item user_url"></div>
E               <div class="txt-item user_ip"></div>
E               <div class="txt-item user_id"></div>
E             </div>
E             <div class="check-input">
E                 <div class="title"></div>
E                 <div class="box-pic"></div>
E                 <div class="box"></div>
E                 <div class="state"></div>
E             </div>
E         </div>
E       </div>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/sha256.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/js.cookie.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/412.js"></script>
E   </body>
E   </html>。

tests.parsers.test_bilibili_need_ck::test_max_size_video

Stack Traces | 0.397s run time

tests/parsers/test_bilibili_need_ck.py:58: in test_max_size_video
    _, audio_url = await parser.extract_download_urls(bvid=bvid)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/bilibili/__init__.py:328: in extract_download_urls
    download_url_data = await video.get_download_url(page_index=page_index)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:492: in get_download_url
    cid = await self.__get_cid_by_index(page_index)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:410: in __get_cid_by_index
    info = await self.__get_info_cached()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:311: in __get_info_cached
    return await self.get_info()
           ^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14............/site-packages/bilibili_api/video.py:247: in get_info
    await Api(**api, credential=self.credential).update_params(**params).result
.venv/lib/python3.14.../bilibili_api/utils/network.py:2393: in result
    return await self.request()
           ^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2385: in request
    raise e
.venv/lib/python3.14.../bilibili_api/utils/network.py:2376: in request
    return await self._request(raw=raw, byte=byte)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2342: in _request
    ret = self._process_response(resp=resp, raw=raw)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2280: in _process_response
    raise NetworkException(resp.code, resp.utf8_text())
E   bilibili_api.exceptions.NetworkException.NetworkException: 网络错误，状态码：412 - <!DOCTYPE html>
E   <html lang="zh-cn">
E   
E   <head>
E       <meta http-equiv="Access-Control-Allow-Origin" content="*" />
E       <meta http-equiv="Page-Enter" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Page-Exit" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
E       <meta name="viewport" content="width=device-width, user-scalable=no, initial-scale=1.0, maximum-scale=1.0, minimum-scale=1.0">
E       <meta name="spm_prefix" content="333.937">
E       <title>出错啦! - bilibili.com</title>
E       <link rel="shortcut icon" href="//static.hdslb.com/images/favicon.ico">
E       <script type="text/javascript" src="//s1.hdslb..../js/jquery/jquery1.7.2.min.js"></script>
E       <style>
E           body {
E             margin: 0;
E             padding: 0;
E             width: 100vw;
E             height: 100vh;
E           }
E          .error-container {
E             height: 100%;
E             width: 100%;
E             display: flex;
E             justify-content: center;
E             align-items: center;
E           }
E           .captcha-content {
E             text-align: center;
E           }
E           .txt-wrap {
E             margin-top: 15px;
E             font-size: 12px;
E             line-height: 22px;
E             color: #999;
E             text-align: left;
E           }
E           .txt-item.err-code {
E             font-size: 28px;
E             font-weight: 700;
E             text-align: center;
E             color: #4c93ff;
E             margin-top: 16px;
E           }
E           
E           .captcha-img {
E             width: 160px;
E             height: 160px;
E             margin: auto;
E             background: url('https://i0.hdslb..../jinkela/long/412/%E9%A1%B5%E9%9D%A2%E7%8A%B6%E6%80%81%E5%9B%BE.png') no-repeat center / cover;
E           }
E           .err-text {
E             color: #03a9f4;
E           }
E           .err-default {
E             font-size: 16px;
E             margin-top: 10px;
E           }
E         </style>
E   </head>
E   
E   <body>
E       <noscript>
E             <strong>抱歉！我们需要允许JavaScript才能够正常运行。请打开后重试~</strong>
E             <strong>错误：412</strong>
E         </noscript>
E         <div class="error-container">
E           <div class="captcha-content">
E             <div class="captcha-img"></div>
E             <div class="txt-item err-code">错误号: 412</div>
E             <div class="txt-item err-text"></div>
E             <div class="txt-item err-default">由于触发哔哩哔哩安全风控策略，该次访问请求被拒绝。 
E               <div class="txt-item">The request was rejected because of the bilibili security control policy.</div>
E             </div>
E             <div class="txt-wrap">
E               <div class="txt-item datetime_now"></div>
E               <div class="txt-item user_url"></div>
E               <div class="txt-item user_ip"></div>
E               <div class="txt-item user_id"></div>
E             </div>
E             <div class="check-input">
E                 <div class="title"></div>
E                 <div class="box-pic"></div>
E                 <div class="box"></div>
E                 <div class="state"></div>
E             </div>
E         </div>
E       </div>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/sha256.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/js.cookie.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/412.js"></script>
E   </body>
E   </html>。

tests.parsers.test_bilibili::test_dynamic

Stack Traces | 0.957s run time

tests/parsers/test_bilibili.py:130: in test_dynamic
    await asyncio.gather(*[test_parse_dynamic(dynamic_url) for dynamic_url in dynamic_urls])
tests/parsers/test_bilibili.py:121: in test_parse_dynamic
    result = await parser.parse_dynamic_or_opus(dynamic_id)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/bilibili/__init__.py:185: in parse_dynamic_or_opus
    return await self._parse_dynamic_info(dynamic_info)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/bilibili/__init__.py:190: in _parse_dynamic_info
    result = await self.parse_video(bvid=archive.bvid)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/bilibili/__init__.py:116: in parse_video
    video_info = convert(await video.get_info(), VideoInfo)
                         ^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../site-packages/bilibili_api/video.py:247: in get_info
    await Api(**api, credential=self.credential).update_params(**params).result
.venv/lib/python3.14.../bilibili_api/utils/network.py:2393: in result
    return await self.request()
           ^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2385: in request
    raise e
.venv/lib/python3.14.../bilibili_api/utils/network.py:2376: in request
    return await self._request(raw=raw, byte=byte)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2342: in _request
    ret = self._process_response(resp=resp, raw=raw)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.venv/lib/python3.14.../bilibili_api/utils/network.py:2280: in _process_response
    raise NetworkException(resp.code, resp.utf8_text())
E   bilibili_api.exceptions.NetworkException.NetworkException: 网络错误，状态码：412 - <!DOCTYPE html>
E   <html lang="zh-cn">
E   
E   <head>
E       <meta http-equiv="Access-Control-Allow-Origin" content="*" />
E       <meta http-equiv="Page-Enter" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Page-Exit" content="blendTrans(Duration=0.5)">
E       <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
E       <meta name="viewport" content="width=device-width, user-scalable=no, initial-scale=1.0, maximum-scale=1.0, minimum-scale=1.0">
E       <meta name="spm_prefix" content="333.937">
E       <title>出错啦! - bilibili.com</title>
E       <link rel="shortcut icon" href="//static.hdslb.com/images/favicon.ico">
E       <script type="text/javascript" src="//s1.hdslb..../js/jquery/jquery1.7.2.min.js"></script>
E       <style>
E           body {
E             margin: 0;
E             padding: 0;
E             width: 100vw;
E             height: 100vh;
E           }
E          .error-container {
E             height: 100%;
E             width: 100%;
E             display: flex;
E             justify-content: center;
E             align-items: center;
E           }
E           .captcha-content {
E             text-align: center;
E           }
E           .txt-wrap {
E             margin-top: 15px;
E             font-size: 12px;
E             line-height: 22px;
E             color: #999;
E             text-align: left;
E           }
E           .txt-item.err-code {
E             font-size: 28px;
E             font-weight: 700;
E             text-align: center;
E             color: #4c93ff;
E             margin-top: 16px;
E           }
E           
E           .captcha-img {
E             width: 160px;
E             height: 160px;
E             margin: auto;
E             background: url('https://i0.hdslb..../jinkela/long/412/%E9%A1%B5%E9%9D%A2%E7%8A%B6%E6%80%81%E5%9B%BE.png') no-repeat center / cover;
E           }
E           .err-text {
E             color: #03a9f4;
E           }
E           .err-default {
E             font-size: 16px;
E             margin-top: 10px;
E           }
E         </style>
E   </head>
E   
E   <body>
E       <noscript>
E             <strong>抱歉！我们需要允许JavaScript才能够正常运行。请打开后重试~</strong>
E             <strong>错误：412</strong>
E         </noscript>
E         <div class="error-container">
E           <div class="captcha-content">
E             <div class="captcha-img"></div>
E             <div class="txt-item err-code">错误号: 412</div>
E             <div class="txt-item err-text"></div>
E             <div class="txt-item err-default">由于触发哔哩哔哩安全风控策略，该次访问请求被拒绝。 
E               <div class="txt-item">The request was rejected because of the bilibili security control policy.</div>
E             </div>
E             <div class="txt-wrap">
E               <div class="txt-item datetime_now"></div>
E               <div class="txt-item user_url"></div>
E               <div class="txt-item user_ip"></div>
E               <div class="txt-item user_id"></div>
E             </div>
E             <div class="check-input">
E                 <div class="title"></div>
E                 <div class="box-pic"></div>
E                 <div class="box"></div>
E                 <div class="state"></div>
E             </div>
E         </div>
E       </div>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/sha256.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/js.cookie.min.js"></script>
E       <script type="text/javascript" charset="utf-8" src="//security.bilibili..../static/js/412.js"></script>
E   </body>
E   </html>。

tests.parsers.test_weibo::test_repost

Stack Traces | 1s run time

tests/parsers/test_weibo.py:60: in test_repost
    await asyncio.gather(*[parse_repost(url) for url in urls])
tests/parsers/test_weibo.py:46: in parse_repost
    parse_result = await parser.parse(keyword, searched)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../nonebot_plugin_parser/parsers/base.py:89: in parse
    return await self._handlers[keyword](self, searched)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/weibo/__init__.py:50: in _parse_m_weibo_cn
    return await self.parse_weibo_id(wid)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
.../parsers/weibo/__init__.py:193: in parse_weibo_id
    weibo_data = common.decoder.decode(response.content).data
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E   msgspec.ValidationError: Object missing required field `data`

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

github-actions · 2026-09-26T04:39:48Z

类型	PIL 耗时(秒)	HTML 耗时(秒)	渲染所用图片总大小(MB)	PIL 导出图片大小(MB)	HTML 导出图片大小(MB)
微博视频2	0.00864	0.73894	0.01280	0.03541	0.18327
微博视频	0.00917	0.74744	0.01280	0.03432	0.18050
微博纯文2	0.02361	0.84210	0.00628	0.11963	0.35888
哔哩哔哩动态(包含emoji)	0.23931	2.70954	0.01244	0.18507	0.55960
bilibili-read	0.28179	2.31888	0.19652	1.34762	3.55924
微博图集(2张)	0.29118	1.05593	4.88308	0.64458	2.21195
微博图集(4张)	0.35948	1.57737	2.34023	0.72816	2.45148
B站动态	0.43249	2.52419	0.00653	1.34777	3.51336
微博图集(9张)	1.05013	1.77353	10.98936	0.98579	3.08158

fix(twitter): use httpx User-Agent header

8b747a9

fllesser merged commit 86ff759 into master Sep 26, 2026
15 of 16 checks passed

fllesser deleted the fllesser/issue594 branch September 26, 2026 04:42

Navigation Menu

Repository navigation

fix(twitter): use httpx User-Agent header - #595

fix(twitter): use httpx User-Agent header#595
fllesser merged 1 commit into
masterfrom
fllesser/issue594

fllesser commented Sep 26, 2026

Uh oh!

codecov Bot commented Sep 26, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Sep 26, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

fllesser commented Sep 26, 2026

Uh oh!

codecov Bot commented Sep 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❌ 4 Tests Failed:

Uh oh!

github-actions Bot commented Sep 26, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

codecov Bot commented Sep 26, 2026 •

edited

Loading