snowflake-connector - 将 csv 上传到 Snowflakes 时出错

尝试上传大小为 100GB 的 csv 并在 tmp 中创建压缩文件后出现此错误

data = sf_file_transfer_agent.result()
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/file_transfer_agent.py", line 722, in result
    "errno": ER_FAILED_TO_UPLOAD_TO_STAGE,
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 258, in errorhandler_wrapper
    error_value,
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 309, in hand_to_other_handler
    cursor.errorhandler(connection, cursor, error_class, error_value)
  File "/apps/tools/python/python36/lib/python3.6/site-packages/snowflake/connector/errors.py", line 195, in default_errorhandler
    cursor=cursor,
snowflake.connector.errors.OperationalError: AttributeError("'StorageCredential' object has no attribute '_command'",)

回答1

不建议加载非常大的文件(例如 100 GB 或更大)。尝试将文件放入 100-250 MB 大小(压缩)并尝试。