Skip to content

Flex-lora里面数据集加载异常,报错如下 #793

@zzzchao123

Description

@zzzchao123

Downloading and preparing dataset json/default to file:///home/xidiannss/test/cache/huggingface/datasets/json/default-d8c646ba37a080c7/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51...
Downloading data files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 6921.29it/s]
Extracting data files: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 1585.75it/s]
Dataset json downloaded and prepared to file:///home/xidiannss/test/cache/huggingface/datasets/json/default-d8c646ba37a080c7/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51. Subsequent calls will reuse this data.
Traceback (most recent call last):
File "/home/xidiannss/test/datasets_test.py", line 2, in
load_dataset(path="json", data_files="global_test.json",cache_dir="cache/huggingface/datasets")
File "/home/xidiannss/anaconda3/envs/zc-lora/lib/python3.10/site-packages/datasets/load.py", line 1794, in load_dataset
ds = builder_instance.as_dataset(split=split, verification_mode=verification_mode, in_memory=keep_in_memory)
File "/home/xidiannss/anaconda3/envs/zc-lora/lib/python3.10/site-packages/datasets/builder.py", line 1089, in as_dataset
raise NotImplementedError(f"Loading a dataset cached in a {type(self._fs).name} is not supported.")
NotImplementedError: Loading a dataset cached in a LocalFileSystem is not supported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions