Skip to content

上传文件报错:分片上传出错: file already closed #509

@leyangjin

Description

@leyangjin

Ⅰ. 使用环境

  1. 操作系统:Linux
  2. aliyunpan版本号:v0.3.7

Ⅱ. 问题描述

试图从位于新加坡的实验室的服务器上,上传一个大小约为10G的压缩文件(格式为.tar.gz)到阿里云盘上。
上传之前,账号已经开通阿里云盘的会员和三方会员。

在上传过程中,速度时快时慢,很多时候速度在256K/s, 64K/s 和0K/s之间反复横跳,就是传一会儿,停一会儿。
更关键的是,打开调试模式后发现,已经传上去的文件块,会在某一时刻,突然报出一长串类似下面这种报错:

[2025-7-8 15:41:25.930] upload file data chunk error UploadErrorTerminate
[2025-7-8 15:41:26.668] 分片上传出错: 分片577 => Put "https://cn-beijing-data.aliyundrive.net/381sDqUe%2F722388654%2F686ca3ad4ead13e45cd84c79ac5f1887c7668486%2F686ca3adee0c2aebefff4ac2ac59c920321d619f?partNumber=577&security-token=CAISvgJ1q6Ft5B2yfSjIr5nQJfL5mYtx8YygaG3T3VYbXu1tuvbTiTz2IHhMf3NpBOkZvvQ1lGlU6%2Fcalq5rR4QAXlDfNUL8GH7Aq1HPWZHInuDox55m4cTXNAr%2BIhr%2F29CoEIedZdjBe%2FCrRknZnytou9XTfimjWFrXWv%2Fgy%2BQQDLItUxK%2FcCBNCfpPOwJms7V6D3bKMuu3OROY6Qi5TmgQ41Uh1

然后在某个报出一长串这种错误后的时刻直接卡住不动。

我已经查找之前的issue的类似问题,按照之前issue中提到的方法,试图删除aliyunpan_uploading.json文件后重新上传,但是发现这个问题依然存在。
我也已经在上传前使用chmod 777 apt.tar.gz命令打开文件的全部权限,但是问题依然存在。

Ⅲ. 期望的结果

这个大小约为10G的压缩文件能够正常被上传,上传速度能达到正常的1M/s以上

Ⅳ. 如何复现问题

1.使用chomd 777 apt.tar.gz,打开文件的全部权限
2. 输入export ALIYUNPAN_VERBOSE=1,打开调试
3. 输入aliyunpan启动程序,挂载的网盘为资源盘(resource)
4. 使用类似 "upload /Users/tickstep/Downloads/apt.tar.gz /tmp" 的命令, 上传压缩文件到网盘

Ⅴ. 请提供相关的错误日志

[2025-7-8 15:32:07.925] use config dir:  /storage_fast/lyjin/aliyunpan-v0.3.7-linux-amd64
[2025-7-8 15:32:07.927] use config dir:  /storage_fast/lyjin/aliyunpan-v0.3.7-linux-amd64
[1] 加入上传队列: /storage_fast/lyjin/data/autoevo_sdxl/evo1065_lora_e100/veri_evo1065_e100_crop_v0_clipf_v0_sizef_v0_75516.tar.gz
[1] 2025-07-08 15:32:25 准备上传: /storage_fast/lyjin/data/autoevo_sdxl/evo1065_lora_e100/veri_evo1065_e100_crop_v0_clipf_v0_sizef_v0_75516.tar.gz => /veri_evo1065_e100/veri_evo1065_e100_crop_v0_clipf_v0_sizef_v0_75516.tar.gz
[2025-7-8 15:32:07.929] [1] 2025-07-08 15:32:25 准备结束, 准备耗时 0秒
[1] 2025-07-08 15:32:25 检测秒传中, 请稍候...
[1] 2025-07-08 15:32:25 秒传失败,开始正常上传文件
[2025-7-8 15:32:08.001] upload task CREATED from instance state
[2025-7-8 15:32:08.001] begin to upload part num: 6
[2025-7-8 15:32:08.001] do request url: https://openapi.alipan.com/adrive/v1.0/openFile/getUploadUrl
[2025-7-8 15:32:08.574] do request url: https://cn-beijing-data.aliyundrive.net/381sDqUe%2F722388654%2F686ca3ad4ead13e45cd84c79ac5f1887c7668486%2F686ca3adee0c2aebefff4ac2ac59c920321d619f?partNumber=6&security-token=CAISvgJ1q6Ft5B2yfSjIr5nQJfL5mYtx8YygaG3T3VYbXu1tuvbTiTz2IHhMf3NpBOkZvvQ1lGlU6%2Fcalq5rR4QAXlDfNUL8GH7Aq1HPWZHInuDox55m4cTXNAr%2BIhr%2F29CoEIedZdjBe%2FCrRknZnytou9XTfimjWFrXWv%2Fgy%2BQQDLItUxK%2FcCBNCfpPOwJms7V6D3bKMuu3OROY6Qi5TmgQ41Uh1jgjtPzkkpfFtkGF1GeXkLFF%2B97DRbG%2FdNRpMZtFVNO44fd7bKKp0lQLs0ARrv4r1fMUqW2X543AUgFLhy2KKMPY99xpFgh9a7j0iCbSGyUu%2FhcRm5sw9%2Byfo34lVYneQzTW63m37uHwufJ7FxfIREfquk63pvSlHLcLPe0Kjzzleo2k1XRPVFF%2B535IaHXuToXDnvSiwGErZvXtuMkagAGd2Ks61rFLmg73%2FWglsCLNj0SlHdr92%2Fz%2Bn1lF8j7lkJ5yxN3DKimmHa5ueEAZR0cvs5K0CjAgNuO2Y%2FP6lfM2TA9FNXR3Xee%2Bv6Wt%2Flr2ogb0HbEvu6RUVCjujUsmzxCdwtvASV%2FG9r75EXlELJM%2B8RdqY46RGPKyGN4edETpuyAA&uploadId=AAFF5854E7AF4EC6895B414ECA6C31FD&x-oss-access-key-id=STS.NZenHMtTPFNKjKb9VNRbAU3xk&x-oss-expires=1751963528&x-oss-signature=N1aTACY06telo7yUeO5Spe4Cw8lJn7lZH87nSVJ5x%2Bc%3D&x-oss-signature-version=OSS2
[2025-7-8 15:32:09.008] use config dir:  /storage_fast/lyjin/aliyunpan-v0.3.7-linux-amd64
[2025-7-8 15:32:09.008] use config dir:  /storage_fast/lyjin/aliyunpan-v0.3.7-linux-amd64
[2025-7-8 15:32:09.015] 成功备份旧的上传数据库文件
[2025-7-8 15:32:09.015] 保存最新上传数据库内容
[1] ↑ 56.62MB/9.05GB(0.61%) 0B/s(0B/s) in 22s, left - ............32m53s ............
[upload] 0:./aliyunpan*                                                        
Welcome to Ubuntu 22.04.2 LTS (GNU/Linux 6.8.0-59-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
[2025-7-8 15:41:25.912] upload file data chunk error  UploadErrorTerminate                            [0/1918]
[2025-7-8 15:41:25.930] 分片上传出错: 分片883 => Put "https://cn-beijing-data.aliyundrive.net/381sDqUe%2F722388654%2F686ca3ad4ead13e45cd84c79ac5f1887c7668486%2F686ca3adee0c2aebefff4ac2ac59c920321d619f?partNumber=883&security-token=CAISvgJ1q6Ft5B2yfSjIr5nQJfL5mYtx8YygaG3T3VYbXu1tuvbTiTz2IHhMf3NpBOkZvvQ1lGlU6%2Fcalq5rR4QAXlDfNUL8GH7Aq1HPWZHInuDox55m4cTXNAr%2BIhr%2F29CoEIedZdjBe%2FCrRknZnytou9XTfimjWFrXWv%2Fgy%2BQQDLItUxK%2FcCBNCfpPOwJms7V6D3bKMuu3OROY6Qi5TmgQ41Uh1jgjtPzkkpfFtkGF1GeXkLFF%2B97DRbG%2FdNRpMZtFVNO44fd7bKKp0lQLs0ARrv4r1fMUqW2X543AUgFLhy2KKMPY99xpFgh9a7j0iCbSGyUu%2FhcRm5sw9%2Byfo34lVYneQzTW63m37uHwufJ7FxfIREfquk63pvSlHLcLPe0Kjzzleo2k1XRPVFF%2B535IaHXuToXDnvSiwGErZvXtuMkagAGd2Ks61rFLmg73%2FWglsCLNj0SlHdr92%2Fz%2Bn1lF8j7lkJ5yxN3DKimmHa5ueEAZR0cvs5K0CjAgNuO2Y%2FP6lfM2TA9FNXR3Xee%2Bv6Wt%2Flr2ogb0HbEvu6RUVCjujUsmzxCdwtvASV%2FG9r75EXlELJM%2B8RdqY46RGPKyGN4edETpuyAA&uploadId=AAFF5854E7AF4EC6895B414ECA6C31FD&x-oss-access-key-id=STS.NZenHMtTPFNKjKb9VNRbAU3xk&x-oss-expires=1751963528&x-oss-signature=aoyYMhHw2EOSrXDWq9aTAuYhTQT3d%2FhCWOq%2B%2BbpvSHI%3D&x-oss-signature-version=OSS2": read /storage_fast/lyjin/data/autoevo_sdxl/evo1065_lora_e100/veri_evo1065_e100_crop_v0_clipf_v0_sizef_v0_75516.tar.gz: file already closed
[2025-7-8 15:41:25.930] upload file data chunk error  UploadErrorTerminate
[2025-7-8 15:41:26.668] 分片上传出错: 分片577 => Put "https://cn-beijing-data.aliyundrive.net/381sDqUe%2F722388654%2F686ca3ad4ead13e45cd84c79ac5f1887c7668486%2F686ca3adee0c2aebefff4ac2ac59c920321d619f?partNumber=577&security-token=CAISvgJ1q6Ft5B2yfSjIr5nQJfL5mYtx8YygaG3T3VYbXu1tuvbTiTz2IHhMf3NpBOkZvvQ1lGlU6%2Fcalq5rR4QAXlDfNUL8GH7Aq1HPWZHInuDox55m4cTXNAr%2BIhr%2F29CoEIedZdjBe%2FCrRknZnytou9XTfimjWFrXWv%2Fgy%2BQQDLItUxK%2FcCBNCfpPOwJms7V6D3bKMuu3OROY6Qi5TmgQ41Uh1jgjtPzkkpfFtkGF1GeXkLFF%2B97DRbG%2FdNRpMZtFVNO44fd7bKKp0lQLs0ARrv4r1fMUqW2X543AUgFLhy2KKMPY99xpFgh9a7j0iCbSGyUu%2FhcRm5sw9%2Byfo34lVYneQzTW63m37uHwufJ7FxfIREfquk63pvSlHLcLPe0Kjzzleo2k1XRPVFF%2B535IaHXuToXDnvSiwGErZvXtuMkagAGd2Ks61rFLmg73%2FWglsCLNj0SlHdr92%2Fz%2Bn1lF8j7lkJ5yxN3DKimmHa5ueEAZR0cvs5K0CjAgNuO2Y%2FP6lfM2TA9FNXR3Xee%2Bv6Wt%2Flr2ogb0HbEvu6RUVCjujUsmzxCdwtvASV%2FG9r75EXlELJM%2B8RdqY46RGPKyGN4edETpuyAA&uploadId=AAFF5854E7AF4EC6895B414ECA6C31FD&x-oss-access-key-id=STS.NZenHMtTPFNKjKb9VNRbAU3xk&x-oss-expires=1751963528&x-oss-signature=WTPyj38JTUECcwvmfs8JKU0WEeaSAFew%2BSL8sj5PRfY%3D&x-oss-signature-version=OSS2": read /storage_fast/lyjin/data/autoevo_sdxl/evo1065_lora_e100/veri_evo1065_e100_crop_v0_clipf_v0_sizef_v0_75516.tar.gz: file already closed
[2025-7-8 15:41:26.668] upload file data chunk error  UploadErrorTerminate

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions