无法在pyspark中导入s3fs
当我尝试使用以下代码在 pyspark 中导入 s3fs 库时：
import s3fs
我收到以下错误：
遇到错误：无法从 'fsspec.asyn' 导入名称 'maybe_sync' (/usr/local/lib/python3.7/site-packages/fsspec/asyn.py) 回溯（最近一次调用最后一次）：文件“/ usr/local/lib/python3.7/site-packages/s3fs/ init .py", line 1, in from .core import S3FileSystem, S3File File "/usr/local/lib/python3.7/site-packages/s3fs /core.py", line 12, in from fsspec.asyn import AsyncFileSystem,sync,sync_wrapper,maybe_syncImportError: cannot import name 'maybe_sync' from 'fsspec.asyn' (/usr/local/lib/python3.7/site-包/fsspec/asyn.py）
该fsspec软件包已安装在我的笔记本中。我实际上已经使用它很长时间了，突然发生了这种情况。我试过谷歌搜索，但找不到这个特定的错误。有没有人遇到过这个？如果是这样，您知道如何解决吗？
回答
很高兴听到这不仅仅是我。看起来如果您 pip install 版本 s3f==0.5.1 和 fsspec==0.8.3，应该可以修复它。
-
Yeah that worked. Also you have to change your bootstrap settings to install the older version of `fsspec` and `s3fs`.
This issue was caused because s3fs released a new version on April 20th and it doesnt use one of the functions that was in the old `fsspec`. They need to allow for backward compatibility 🙁